Aug 27 03:36:11 user nova-compute[72990]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 27 03:36:14 user nova-compute[72990]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72990) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72990) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72990) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 03:36:14 user nova-compute[72990]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:36:14 user nova-compute[72990]: INFO nova.virt.driver [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 27 03:36:14 user nova-compute[72990]: INFO nova.compute.provider_config [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] Acquiring lock "singleton_lock" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] Acquired lock "singleton_lock" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] Releasing lock "singleton_lock" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] Full set of CONF: {{(pid=72990) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ******************************************************************************** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] Configuration options gathered from: {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ================================================================================ {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] allow_resize_to_same_host      = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] arq_binding_timeout            = 300 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] backdoor_port                  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] backdoor_socket                = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] block_device_allocate_retries  = 300 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] block_device_allocate_retries_interval = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cert                           = self.pem {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute_monitors               = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] config_dir                     = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] config_drive_format            = iso9660 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] config_source                  = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] console_host                   = user {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] control_exchange               = nova {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cpu_allocation_ratio           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] daemon                         = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] debug                          = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] default_access_ip_network_name = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] default_availability_zone      = nova {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] default_ephemeral_format       = ext4 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] default_green_pool_size        = 1000 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] default_schedule_zone          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] disk_allocation_ratio          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] enable_new_services            = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] enabled_ssl_apis               = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] flat_injected                  = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] force_config_drive             = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] force_raw_images               = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] graceful_shutdown_timeout      = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] heal_instance_info_cache_interval = 60 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] host                           = user {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] instance_build_timeout         = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] instance_delete_interval       = 300 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] instance_name_template         = instance-%08x {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] instance_usage_audit           = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] instance_usage_audit_period    = month {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] internal_service_availability_zone = internal {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] key                            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] live_migration_retry_count     = 30 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] log_config_append              = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] log_dir                        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] log_file                       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] log_options                    = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] log_rotate_interval            = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] log_rotate_interval_type       = days {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] log_rotation_type              = none {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] long_rpc_timeout               = 1800 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] max_concurrent_builds          = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] max_concurrent_live_migrations = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] max_concurrent_snapshots       = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] max_local_block_devices        = 3 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] max_logfile_count              = 30 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] max_logfile_size_mb            = 200 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] maximum_instance_delete_attempts = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] metadata_listen                = 0.0.0.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] metadata_listen_port           = 8775 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] metadata_workers               = 3 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] migrate_max_retries            = -1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] mkisofs_cmd                    = genisoimage {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] my_ip                          = 10.0.0.210 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] network_allocate_retries       = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] osapi_compute_listen_port      = 8774 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] osapi_compute_unique_server_name_scope =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] osapi_compute_workers          = 3 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] password_length                = 12 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] periodic_enable                = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] periodic_fuzzy_delay           = 60 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] pointer_model                  = ps2mouse {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] preallocate_images             = none {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] publish_errors                 = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] pybasedir                      = /opt/stack/nova {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ram_allocation_ratio           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] rate_limit_burst               = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] rate_limit_except_level        = CRITICAL {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] rate_limit_interval            = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] reboot_timeout                 = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] reclaim_instance_interval      = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] record                         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] reimage_timeout_per_gb         = 60 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] report_interval                = 120 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] rescue_timeout                 = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] reserved_host_cpus             = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] reserved_host_disk_mb          = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] reserved_host_memory_mb        = 512 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] reserved_huge_pages            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] resize_confirm_window          = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] resize_fs_using_block_device   = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] resume_guests_state_on_host_boot = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] rpc_response_timeout           = 60 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] run_external_periodic_tasks    = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] running_deleted_instance_action = reap {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] running_deleted_instance_timeout = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] scheduler_instance_sync_interval = 120 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] service_down_time              = 720 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] servicegroup_driver            = db {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] shelved_offload_time           = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] shelved_poll_interval          = 3600 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] shutdown_timeout               = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] source_is_ipv6                 = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ssl_only                       = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] state_path                     = /opt/stack/data/nova {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] sync_power_state_interval      = 600 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] sync_power_state_pool_size     = 1000 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] syslog_log_facility            = LOG_USER {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] tempdir                        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] timeout_nbd                    = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] transport_url                  = **** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] update_resources_interval      = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] use_cow_images                 = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] use_eventlog                   = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] use_journal                    = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] use_json                       = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] use_rootwrap_daemon            = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] use_stderr                     = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] use_syslog                     = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vcpu_pin_set                   = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plugging_is_fatal          = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plugging_timeout           = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] virt_mkfs                      = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] volume_usage_poll_interval     = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] watch_log_file                 = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] web                            = /usr/share/spice-html5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_concurrency.disable_process_locking = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.auth_strategy              = keystone {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.compute_link_prefix        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.dhcp_domain                = novalocal {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:14 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.enable_instance_password   = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.glance_link_prefix         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.instance_list_per_project_cells = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.list_records_by_skipping_down_cells = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.local_metadata_per_cell    = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.max_limit                  = 1000 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.metadata_cache_expiration  = 15 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.neutron_default_tenant_id  = default {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.use_forwarded_for          = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.use_neutron_default_nets   = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.vendordata_dynamic_targets = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.vendordata_jsonfile_path   = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.backend_argument         = **** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.config_prefix            = cache.oslo {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.dead_timeout             = 60.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.debug_cache_backend      = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.enable_retry_client      = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.enable_socket_keepalive  = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.enabled                  = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.expiration_time          = 600 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.hashclient_retry_attempts = 2 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.memcache_dead_retry      = 300 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.memcache_password        =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.memcache_sasl_enabled    = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.memcache_username        =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.proxies                  = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.retry_attempts           = 2 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.retry_delay              = 0.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.socket_keepalive_count   = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.socket_keepalive_idle    = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.socket_keepalive_interval = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.tls_allowed_ciphers      = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.tls_cafile               = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.tls_certfile             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.tls_enabled              = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cache.tls_keyfile              = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.auth_section            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.auth_type               = password {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.cafile                  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.certfile                = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.collect_timing          = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.cross_az_attach         = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.debug                   = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.endpoint_template       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.http_retries            = 3 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.insecure                = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.keyfile                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.os_region_name          = RegionOne {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.split_loggers           = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cinder.timeout                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute.cpu_dedicated_set      = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute.cpu_shared_set         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute.image_type_exclude_list = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute.resource_provider_association_refresh = 300 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute.shutdown_retry_interval = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] conductor.workers              = 3 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] console.allowed_origins        = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] console.ssl_ciphers            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] console.ssl_minimum_version    = default {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] consoleauth.token_ttl          = 600 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.cafile                  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.certfile                = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.collect_timing          = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.connect_retries         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.connect_retry_delay     = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.endpoint_override       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.insecure                = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.keyfile                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.max_version             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.min_version             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.region_name             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.service_name            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.service_type            = accelerator {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.split_loggers           = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.status_code_retries     = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.status_code_retry_delay = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.timeout                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] cyborg.version                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.backend               = sqlalchemy {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.connection            = **** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.connection_debug      = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.connection_parameters =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.connection_recycle_time = 3600 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.connection_trace      = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.db_inc_retry_interval = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.db_max_retries        = 20 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.db_max_retry_interval = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.db_retry_interval     = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.max_overflow          = 50 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.max_pool_size         = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.max_retries           = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.mysql_enable_ndb      = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.mysql_wsrep_sync_wait = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.pool_timeout          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.retry_interval        = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.slave_connection      = **** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] database.sqlite_synchronous    = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.backend           = sqlalchemy {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.connection        = **** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.connection_debug  = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.connection_parameters =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.connection_recycle_time = 3600 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.connection_trace  = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.db_inc_retry_interval = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.db_max_retries    = 20 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.db_max_retry_interval = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.db_retry_interval = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.max_overflow      = 50 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.max_pool_size     = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.max_retries       = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.mysql_enable_ndb  = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.pool_timeout      = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.retry_interval    = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.slave_connection  = **** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] api_database.sqlite_synchronous = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] devices.enabled_mdev_types     = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ephemeral_storage_encryption.enabled = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.api_servers             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.cafile                  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.certfile                = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.collect_timing          = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.connect_retries         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.connect_retry_delay     = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.debug                   = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.default_trusted_certificate_ids = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.enable_certificate_validation = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.enable_rbd_download     = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.endpoint_override       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.insecure                = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.keyfile                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.max_version             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.min_version             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.num_retries             = 3 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.rbd_ceph_conf           =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.rbd_connect_timeout     = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.rbd_pool                =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.rbd_user                =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.region_name             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.service_name            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.service_type            = image {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.split_loggers           = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.status_code_retries     = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.status_code_retry_delay = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.timeout                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.verify_glance_signatures = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] glance.version                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] guestfs.debug                  = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.config_drive_cdrom      = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.config_drive_inject_password = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.enable_remotefx         = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.instances_path_share    =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.limit_cpu_features      = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.use_multipath_io        = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.vswitch_name            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] mks.enabled                    = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] image_cache.manager_interval   = 2400 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] image_cache.precache_concurrency = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] image_cache.remove_unused_base_images = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] image_cache.subdirectory_name  = _base {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.api_max_retries         = 60 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.api_retry_interval      = 2 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.auth_section            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.auth_type               = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.cafile                  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.certfile                = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.collect_timing          = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.connect_retries         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.connect_retry_delay     = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.endpoint_override       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.insecure                = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.keyfile                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.max_version             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.min_version             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.partition_key           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.peer_list               = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.region_name             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.serial_console_state_timeout = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.service_name            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.service_type            = baremetal {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.split_loggers           = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.status_code_retries     = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.status_code_retry_delay = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.timeout                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ironic.version                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] key_manager.fixed_key          = **** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.barbican_api_version  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.barbican_endpoint     = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.barbican_endpoint_type = public {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.barbican_region_name  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.cafile                = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.certfile              = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.collect_timing        = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.insecure              = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.keyfile               = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.number_of_retries     = 60 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.retry_delay           = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.send_service_user_token = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.split_loggers         = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.timeout               = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.verify_ssl            = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican.verify_ssl_path       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican_service_user.auth_section = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican_service_user.auth_type = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican_service_user.cafile   = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican_service_user.certfile = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican_service_user.collect_timing = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican_service_user.insecure = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican_service_user.keyfile  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican_service_user.split_loggers = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] barbican_service_user.timeout  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.approle_role_id          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.approle_secret_id        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.cafile                   = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.certfile                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.collect_timing           = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.insecure                 = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.keyfile                  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.kv_mountpoint            = secret {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.kv_version               = 2 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.namespace                = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.root_token_id            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.split_loggers            = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.ssl_ca_crt_file          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.timeout                  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.use_ssl                  = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.cafile                = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.certfile              = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.collect_timing        = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.connect_retries       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.connect_retry_delay   = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.endpoint_override     = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.insecure              = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.keyfile               = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.max_version           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.min_version           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.region_name           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.service_name          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.service_type          = identity {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.split_loggers         = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.status_code_retries   = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.status_code_retry_delay = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.timeout               = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] keystone.version               = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.connection_uri         =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.cpu_mode               = custom {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: WARNING oslo_config.cfg [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.cpu_power_governor_high = performance {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.cpu_power_management   = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.device_detach_attempts = 8 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.device_detach_timeout  = 20 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.disk_cachemodes        = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.disk_prefix            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.enabled_perf_events    = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.file_backed_memory     = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.gid_maps               = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.hw_disk_discard        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.hw_machine_type        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.images_rbd_pool        = rbd {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.images_type            = default {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.images_volume_group    = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.inject_key             = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.inject_partition       = -2 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.inject_password        = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.iscsi_iface            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.iser_use_multipath     = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_downtime = 500 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_inbound_addr = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_scheme  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_timeout_action = abort {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_tunnelled = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: WARNING oslo_config.cfg [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 27 03:36:15 user nova-compute[72990]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 27 03:36:15 user nova-compute[72990]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 27 03:36:15 user nova-compute[72990]: and ``live_migration_inbound_addr`` respectively.
Aug 27 03:36:15 user nova-compute[72990]: ).  Its value may be silently ignored in the future.
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.live_migration_with_native_tls = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.max_queues             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.nfs_mount_options      = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.num_pcie_ports         = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.pmem_namespaces        = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.quobyte_client_cfg     = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.rbd_secret_uuid        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.rbd_user               = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.rescue_image_id        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.rescue_kernel_id       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.rx_queue_size          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.smbfs_mount_options    =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.snapshot_compression   = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.snapshot_image_format  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.sparse_logical_volumes = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.swtpm_enabled          = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.swtpm_group            = tss {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.swtpm_user             = tss {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.sysinfo_serial         = unique {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.tb_cache_size          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.tx_queue_size          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.uid_maps               = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.use_virtio_for_bridges = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.virt_type              = kvm {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.volume_clear           = zero {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.volume_clear_size      = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.volume_use_multipath   = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.vzstorage_cache_path   = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.auth_section           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.auth_type              = password {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.cafile                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.certfile               = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.collect_timing         = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.connect_retries        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.connect_retry_delay    = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.default_floating_pool  = public {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.endpoint_override      = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.extension_sync_interval = 600 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.http_retries           = 3 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.insecure               = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.keyfile                = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.max_version            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.min_version            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.ovs_bridge             = br-int {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.physnets               = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.region_name            = RegionOne {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.service_metadata_proxy = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.service_name           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.service_type           = network {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.split_loggers          = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.status_code_retries    = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.status_code_retry_delay = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.timeout                = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] neutron.version                = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] notifications.bdms_in_notifications = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] notifications.default_level    = INFO {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] notifications.notification_format = unversioned {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] notifications.notify_on_state_change = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] pci.alias                      = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] pci.device_spec                = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] pci.report_in_placement        = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.auth_section         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.auth_type            = password {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.cafile               = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.certfile             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.collect_timing       = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.connect_retries      = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.connect_retry_delay  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.default_domain_id    = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.default_domain_name  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.domain_id            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.domain_name          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.endpoint_override    = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.insecure             = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.keyfile              = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.max_version          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.min_version          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.password             = **** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.project_domain_id    = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.project_domain_name  = Default {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.project_id           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.project_name         = service {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.region_name          = RegionOne {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.service_name         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.service_type         = placement {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.split_loggers        = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.status_code_retries  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.status_code_retry_delay = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.system_scope         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.timeout              = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.trust_id             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.user_domain_id       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.user_domain_name     = Default {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.user_id              = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.username             = placement {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] placement.version              = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.cores                    = 20 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.count_usage_from_placement = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.injected_file_content_bytes = 10240 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.injected_file_path_length = 255 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.injected_files           = 5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.instances                = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.key_pairs                = 100 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.metadata_items           = 128 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.ram                      = 51200 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.recheck_quota            = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.server_group_members     = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] quota.server_groups            = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] rdp.enabled                    = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] scheduler.image_metadata_prefilter = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] scheduler.max_attempts         = 3 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] scheduler.max_placement_results = 1000 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] scheduler.workers              = 3 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.host_subset_size = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.isolated_hosts = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.isolated_images = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.pci_in_placement = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.track_instance_changes = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] metrics.required               = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] metrics.weight_multiplier      = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] metrics.weight_setting         = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] serial_console.enabled         = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] serial_console.port_range      = 10000:20000 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] serial_console.serialproxy_port = 6083 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] service_user.auth_section      = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] service_user.auth_type         = password {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] service_user.cafile            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] service_user.certfile          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] service_user.collect_timing    = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] service_user.insecure          = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] service_user.keyfile           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] service_user.send_service_user_token = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] service_user.split_loggers     = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] service_user.timeout           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] spice.agent_enabled            = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] spice.enabled                  = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] spice.html5proxy_port          = 6082 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] spice.image_compression        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] spice.jpeg_compression         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] spice.playback_compression     = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] spice.server_listen            = 127.0.0.1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] spice.streaming_mode           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] spice.zlib_compression         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] upgrade_levels.baseapi         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] upgrade_levels.cert            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] upgrade_levels.compute         = auto {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] upgrade_levels.conductor       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] upgrade_levels.scheduler       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vendordata_dynamic_auth.cafile = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vendordata_dynamic_auth.certfile = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vendordata_dynamic_auth.insecure = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vendordata_dynamic_auth.timeout = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.api_retry_count         = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.ca_file                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.cache_prefix            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.cluster_name            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.connection_pool_size    = 10 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.console_delay_seconds   = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.datastore_regex         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.host_ip                 = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.host_password           = **** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.host_port               = 443 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.host_username           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.insecure                = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.integration_bridge      = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.maximum_objects         = 100 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.pbm_default_policy      = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.pbm_enabled             = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.pbm_wsdl_location       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.serial_port_proxy_uri   = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.serial_port_service_uri = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.task_poll_interval      = 0.5 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.use_linked_clone        = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.vnc_keymap              = en-us {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.vnc_port                = 5900 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vmware.vnc_port_total          = 10000 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vnc.auth_schemes               = ['none'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vnc.enabled                    = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vnc.novncproxy_port            = 6080 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vnc.vencrypt_ca_certs          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vnc.vencrypt_client_cert       = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vnc.vencrypt_client_key        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.disable_rootwrap   = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.enable_numa_live_migration = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.libvirt_disable_apic = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] wsgi.client_socket_timeout     = 900 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] wsgi.default_pool_size         = 1000 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] wsgi.keep_alive                = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] wsgi.max_header_line           = 16384 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] wsgi.ssl_ca_file               = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] wsgi.ssl_cert_file             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] wsgi.ssl_key_file              = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] wsgi.tcp_keepidle              = 600 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] zvm.ca_file                    = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] zvm.cloud_connector_url        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] zvm.reachable_timeout          = 300 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_policy.enforce_new_defaults = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_policy.enforce_scope      = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_policy.policy_default_rule = default {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler.connection_string     = messaging:// {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler.enabled               = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler.es_doc_type           = notification {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler.es_scroll_size        = 10000 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler.es_scroll_time        = 2m {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler.filter_error_trace    = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler.hmac_keys             = **** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler.sentinel_service_name = mymaster {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler.socket_timeout        = 0.1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler.trace_requests        = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler.trace_sqlalchemy      = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler_jaeger.process_tags   = {} {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler_jaeger.service_name_prefix = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] profiler_otlp.service_name_prefix = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] remote_debug.host              = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] remote_debug.port              = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_notifications.retry = -1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.auth_section        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.auth_type           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.cafile              = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.certfile            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.collect_timing      = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.connect_retries     = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.connect_retry_delay = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.endpoint_id         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.endpoint_override   = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.insecure            = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.keyfile             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.max_version         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.min_version         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.region_name         = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.service_name        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.service_type        = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.split_loggers       = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.status_code_retries = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.status_code_retry_delay = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.timeout             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.valid_interfaces    = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_limit.version             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_reports.file_event_handler = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] oslo_reports.log_dir           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plug_ovs_privileged.group  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] vif_plug_ovs_privileged.user   = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_ovs.isolate_vif         = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] os_brick.lock_path             = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] privsep_osbrick.capabilities   = [21] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] privsep_osbrick.group          = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] privsep_osbrick.helper_command = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] privsep_osbrick.user           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] nova_sys_admin.group           = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] nova_sys_admin.helper_command  = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] nova_sys_admin.user            = None {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG oslo_service.service [None req-e0340d56-3822-4624-97d4-180e2f6fad74 None None] ******************************************************************************** {{(pid=72990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 27 03:36:15 user nova-compute[72990]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 27 03:36:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Starting native event thread {{(pid=72990) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Starting green dispatch thread {{(pid=72990) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Starting connection event dispatch thread {{(pid=72990) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Connecting to libvirt: qemu:///system {{(pid=72990) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fa7183527a0> {{(pid=72990) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 27 03:36:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fa7183527a0> {{(pid=72990) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 27 03:36:15 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Connection event '1' reason 'None'
Aug 27 03:36:15 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 27 03:36:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.mount [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Initialising _HostMountState generation 0 {{(pid=72990) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 27 03:36:22 user nova-compute[72990]: INFO nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Libvirt host capabilities <capabilities>
Aug 27 03:36:22 user nova-compute[72990]:   <host>
Aug 27 03:36:22 user nova-compute[72990]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 27 03:36:22 user nova-compute[72990]:     <cpu>
Aug 27 03:36:22 user nova-compute[72990]:       <arch>x86_64</arch>
Aug 27 03:36:22 user nova-compute[72990]:       <model>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <vendor>Intel</vendor>
Aug 27 03:36:22 user nova-compute[72990]:       <microcode version='1070'/>
Aug 27 03:36:22 user nova-compute[72990]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 27 03:36:22 user nova-compute[72990]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='ss'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='vmx'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='pcid'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='osxsave'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='hypervisor'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='arat'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='tsc_adjust'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='md-clear'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='arch-capabilities'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='invtsc'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='rsba'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature name='skip-l1dfl-vmentry'/>
Aug 27 03:36:22 user nova-compute[72990]:       <pages unit='KiB' size='4'/>
Aug 27 03:36:22 user nova-compute[72990]:       <pages unit='KiB' size='2048'/>
Aug 27 03:36:22 user nova-compute[72990]:     </cpu>
Aug 27 03:36:22 user nova-compute[72990]:     <power_management>
Aug 27 03:36:22 user nova-compute[72990]:       <suspend_mem/>
Aug 27 03:36:22 user nova-compute[72990]:       <suspend_disk/>
Aug 27 03:36:22 user nova-compute[72990]:       <suspend_hybrid/>
Aug 27 03:36:22 user nova-compute[72990]:     </power_management>
Aug 27 03:36:22 user nova-compute[72990]:     <iommu support='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     <migration_features>
Aug 27 03:36:22 user nova-compute[72990]:       <live/>
Aug 27 03:36:22 user nova-compute[72990]:       <uri_transports>
Aug 27 03:36:22 user nova-compute[72990]:         <uri_transport>tcp</uri_transport>
Aug 27 03:36:22 user nova-compute[72990]:         <uri_transport>rdma</uri_transport>
Aug 27 03:36:22 user nova-compute[72990]:       </uri_transports>
Aug 27 03:36:22 user nova-compute[72990]:     </migration_features>
Aug 27 03:36:22 user nova-compute[72990]:     <topology>
Aug 27 03:36:22 user nova-compute[72990]:       <cells num='2'>
Aug 27 03:36:22 user nova-compute[72990]:         <cell id='0'>
Aug 27 03:36:22 user nova-compute[72990]:           <memory unit='KiB'>8140616</memory>
Aug 27 03:36:22 user nova-compute[72990]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 27 03:36:22 user nova-compute[72990]:           <pages unit='KiB' size='2048'>0</pages>
Aug 27 03:36:22 user nova-compute[72990]:           <distances>
Aug 27 03:36:22 user nova-compute[72990]:             <sibling id='0' value='10'/>
Aug 27 03:36:22 user nova-compute[72990]:             <sibling id='1' value='20'/>
Aug 27 03:36:22 user nova-compute[72990]:           </distances>
Aug 27 03:36:22 user nova-compute[72990]:           <cpus num='6'>
Aug 27 03:36:22 user nova-compute[72990]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 27 03:36:22 user nova-compute[72990]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 27 03:36:22 user nova-compute[72990]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 27 03:36:22 user nova-compute[72990]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 27 03:36:22 user nova-compute[72990]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 27 03:36:22 user nova-compute[72990]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 27 03:36:22 user nova-compute[72990]:           </cpus>
Aug 27 03:36:22 user nova-compute[72990]:         </cell>
Aug 27 03:36:22 user nova-compute[72990]:         <cell id='1'>
Aug 27 03:36:22 user nova-compute[72990]:           <memory unit='KiB'>8255100</memory>
Aug 27 03:36:22 user nova-compute[72990]:           <pages unit='KiB' size='4'>2063775</pages>
Aug 27 03:36:22 user nova-compute[72990]:           <pages unit='KiB' size='2048'>0</pages>
Aug 27 03:36:22 user nova-compute[72990]:           <distances>
Aug 27 03:36:22 user nova-compute[72990]:             <sibling id='0' value='20'/>
Aug 27 03:36:22 user nova-compute[72990]:             <sibling id='1' value='10'/>
Aug 27 03:36:22 user nova-compute[72990]:           </distances>
Aug 27 03:36:22 user nova-compute[72990]:           <cpus num='6'>
Aug 27 03:36:22 user nova-compute[72990]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 27 03:36:22 user nova-compute[72990]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 27 03:36:22 user nova-compute[72990]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 27 03:36:22 user nova-compute[72990]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 27 03:36:22 user nova-compute[72990]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 27 03:36:22 user nova-compute[72990]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 27 03:36:22 user nova-compute[72990]:           </cpus>
Aug 27 03:36:22 user nova-compute[72990]:         </cell>
Aug 27 03:36:22 user nova-compute[72990]:       </cells>
Aug 27 03:36:22 user nova-compute[72990]:     </topology>
Aug 27 03:36:22 user nova-compute[72990]:     <cache>
Aug 27 03:36:22 user nova-compute[72990]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 27 03:36:22 user nova-compute[72990]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 27 03:36:22 user nova-compute[72990]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 27 03:36:22 user nova-compute[72990]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 27 03:36:22 user nova-compute[72990]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 27 03:36:22 user nova-compute[72990]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 27 03:36:22 user nova-compute[72990]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 27 03:36:22 user nova-compute[72990]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 27 03:36:22 user nova-compute[72990]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 27 03:36:22 user nova-compute[72990]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 27 03:36:22 user nova-compute[72990]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 27 03:36:22 user nova-compute[72990]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 27 03:36:22 user nova-compute[72990]:     </cache>
Aug 27 03:36:22 user nova-compute[72990]:     <secmodel>
Aug 27 03:36:22 user nova-compute[72990]:       <model>apparmor</model>
Aug 27 03:36:22 user nova-compute[72990]:       <doi>0</doi>
Aug 27 03:36:22 user nova-compute[72990]:     </secmodel>
Aug 27 03:36:22 user nova-compute[72990]:     <secmodel>
Aug 27 03:36:22 user nova-compute[72990]:       <model>dac</model>
Aug 27 03:36:22 user nova-compute[72990]:       <doi>0</doi>
Aug 27 03:36:22 user nova-compute[72990]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 27 03:36:22 user nova-compute[72990]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 27 03:36:22 user nova-compute[72990]:     </secmodel>
Aug 27 03:36:22 user nova-compute[72990]:   </host>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='alpha'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>64</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>clipper</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='armv6l'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>spitz</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>nuri</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>kzm</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sx1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>z2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>tosa</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>n810</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>n800</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>terrier</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>midway</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>microbit</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>verdex</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>highbank</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>akita</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>connex</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>collie</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='armv7l'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>spitz</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>nuri</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>kzm</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sx1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>z2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>tosa</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>n810</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>n800</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>terrier</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>midway</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>microbit</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>verdex</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>highbank</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>akita</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>connex</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>collie</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='aarch64'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>64</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>spitz</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>nuri</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>kzm</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sx1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>z2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>tosa</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>n810</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>n800</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>terrier</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>midway</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>microbit</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>verdex</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>raspi3b</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>highbank</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>akita</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>connex</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>collie</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <acpi default='on' toggle='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='cris'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='i686'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>x-remote</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>isapc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>microvm</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='kvm'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <pae/>
Aug 27 03:36:22 user nova-compute[72990]:       <nonpae/>
Aug 27 03:36:22 user nova-compute[72990]:       <acpi default='on' toggle='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:       <apic default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='m68k'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>an5206</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>q800</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>next-cube</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='microblaze'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='microblazeel'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='mips'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='16'>malta</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='mipsel'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='16'>malta</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='mips64'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>64</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='16'>malta</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>pica61</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>magnum</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='mips64el'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>64</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='16'>malta</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>pica61</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>magnum</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='16'>boston</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='ppc'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mac99</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>40p</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>taihu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='ppc64'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>64</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2048'>powernv9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>taihu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2048'>powernv10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>40p</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mac99</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2048'>powernv8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='ppc64le'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>64</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2048'>powernv9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>taihu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2048'>powernv10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>40p</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>mac99</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2048'>powernv8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='riscv32'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='8'>spike</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>opentitan</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='5'>sifive_u</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sifive_e</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='8'>virt</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='riscv64'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>64</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='8'>spike</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='5'>sifive_u</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>shakti_c</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sifive_e</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='8'>virt</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='s390x'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>64</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='sh4'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>shix</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>r2d</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='sh4eb'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>64</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>shix</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>r2d</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='sparc'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>SS-5</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>SS-20</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>LX</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>SS-4</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>SS-10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>Voyager</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='sparc64'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>64</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sun4u</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>niagara</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>sun4v</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='x86_64'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>64</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>x-remote</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='1'>isapc</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>microvm</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='kvm'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <acpi default='on' toggle='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:       <apic default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='xtensa'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>sim</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>kc705</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>ml605</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>virt</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>lx200</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>lx60</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]:   <guest>
Aug 27 03:36:22 user nova-compute[72990]:     <os_type>hvm</os_type>
Aug 27 03:36:22 user nova-compute[72990]:     <arch name='xtensaeb'>
Aug 27 03:36:22 user nova-compute[72990]:       <wordsize>32</wordsize>
Aug 27 03:36:22 user nova-compute[72990]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='4'>sim</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>kc705</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>ml605</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>virt</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>lx200</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>lx60</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 27 03:36:22 user nova-compute[72990]:       <domain type='qemu'/>
Aug 27 03:36:22 user nova-compute[72990]:     </arch>
Aug 27 03:36:22 user nova-compute[72990]:     <features>
Aug 27 03:36:22 user nova-compute[72990]:       <cpuselection/>
Aug 27 03:36:22 user nova-compute[72990]:       <deviceboot/>
Aug 27 03:36:22 user nova-compute[72990]:       <disksnapshot default='on' toggle='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     </features>
Aug 27 03:36:22 user nova-compute[72990]:   </guest>
Aug 27 03:36:22 user nova-compute[72990]: </capabilities>
Aug 27 03:36:22 user nova-compute[72990]: 
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 27 03:36:22 user nova-compute[72990]: <domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 03:36:22 user nova-compute[72990]:   <domain>kvm</domain>
Aug 27 03:36:22 user nova-compute[72990]:   <machine>pc-i440fx-jammy</machine>
Aug 27 03:36:22 user nova-compute[72990]:   <arch>i686</arch>
Aug 27 03:36:22 user nova-compute[72990]:   <vcpu max='255'/>
Aug 27 03:36:22 user nova-compute[72990]:   <iothreads supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:   <os supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='firmware'/>
Aug 27 03:36:22 user nova-compute[72990]:     <loader supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>rom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pflash</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='readonly'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>yes</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='secure'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </loader>
Aug 27 03:36:22 user nova-compute[72990]:   </os>
Aug 27 03:36:22 user nova-compute[72990]:   <cpu>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-passthrough' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='hostPassthroughMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='maximum' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='maximumMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>on</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-model' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <vendor>Intel</vendor>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ss'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='vmx'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='pcid'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='hypervisor'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arat'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='umip'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='md-clear'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibpb'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibrs'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='erms'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='lm'/>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='custom' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>qemu64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>qemu32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>phenom</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>n270</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>kvm64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>kvm32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>coreduo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>core2duo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>athlon</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Westmere</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Snowridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Penryn</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G5</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G4</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G1</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Nehalem</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Rome</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Milan</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Dhyana</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cooperlake</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Conroe</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>486</model>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:   </cpu>
Aug 27 03:36:22 user nova-compute[72990]:   <memoryBacking supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='sourceType'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>file</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>anonymous</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>memfd</value>
Aug 27 03:36:22 user nova-compute[72990]:     </enum>
Aug 27 03:36:22 user nova-compute[72990]:   </memoryBacking>
Aug 27 03:36:22 user nova-compute[72990]:   <devices>
Aug 27 03:36:22 user nova-compute[72990]:     <disk supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='diskDevice'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>disk</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cdrom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>floppy</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>lun</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='bus'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>ide</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>fdc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sata</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </disk>
Aug 27 03:36:22 user nova-compute[72990]:     <graphics supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sdl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vnc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>spice</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egl-headless</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </graphics>
Aug 27 03:36:22 user nova-compute[72990]:     <video supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='modelType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cirrus</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vmvga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>qxl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>none</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>bochs</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>ramfb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </video>
Aug 27 03:36:22 user nova-compute[72990]:     <hostdev supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='mode'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>subsystem</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='startupPolicy'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>default</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>mandatory</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>requisite</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>optional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='subsysType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pci</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='capsType'/>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='pciBackend'/>
Aug 27 03:36:22 user nova-compute[72990]:     </hostdev>
Aug 27 03:36:22 user nova-compute[72990]:     <rng supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>random</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egd</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>builtin</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </rng>
Aug 27 03:36:22 user nova-compute[72990]:     <filesystem supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='driverType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>path</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>handle</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtiofs</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </filesystem>
Aug 27 03:36:22 user nova-compute[72990]:     <tpm supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-tis</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-crb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>passthrough</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>emulator</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </tpm>
Aug 27 03:36:22 user nova-compute[72990]:   </devices>
Aug 27 03:36:22 user nova-compute[72990]:   <features>
Aug 27 03:36:22 user nova-compute[72990]:     <gic supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     <vmcoreinfo supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <genid supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backingStoreInput supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backup supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <sev supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:   </features>
Aug 27 03:36:22 user nova-compute[72990]: </domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:  {{(pid=72990) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 27 03:36:22 user nova-compute[72990]: <domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 03:36:22 user nova-compute[72990]:   <domain>kvm</domain>
Aug 27 03:36:22 user nova-compute[72990]:   <machine>pc-q35-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:   <arch>i686</arch>
Aug 27 03:36:22 user nova-compute[72990]:   <vcpu max='288'/>
Aug 27 03:36:22 user nova-compute[72990]:   <iothreads supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:   <os supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='firmware'/>
Aug 27 03:36:22 user nova-compute[72990]:     <loader supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>rom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pflash</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='readonly'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>yes</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='secure'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </loader>
Aug 27 03:36:22 user nova-compute[72990]:   </os>
Aug 27 03:36:22 user nova-compute[72990]:   <cpu>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-passthrough' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='hostPassthroughMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='maximum' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='maximumMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>on</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-model' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <vendor>Intel</vendor>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ss'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='vmx'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='pcid'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='hypervisor'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arat'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='umip'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='md-clear'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibpb'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibrs'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='erms'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='lm'/>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='custom' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>qemu64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>qemu32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>phenom</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>n270</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>kvm64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>kvm32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>coreduo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>core2duo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>athlon</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Westmere</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Snowridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Penryn</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G5</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G4</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G1</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Nehalem</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Rome</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Milan</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Dhyana</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cooperlake</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Conroe</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>486</model>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:   </cpu>
Aug 27 03:36:22 user nova-compute[72990]:   <memoryBacking supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='sourceType'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>file</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>anonymous</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>memfd</value>
Aug 27 03:36:22 user nova-compute[72990]:     </enum>
Aug 27 03:36:22 user nova-compute[72990]:   </memoryBacking>
Aug 27 03:36:22 user nova-compute[72990]:   <devices>
Aug 27 03:36:22 user nova-compute[72990]:     <disk supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='diskDevice'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>disk</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cdrom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>floppy</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>lun</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='bus'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>fdc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sata</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </disk>
Aug 27 03:36:22 user nova-compute[72990]:     <graphics supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sdl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vnc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>spice</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egl-headless</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </graphics>
Aug 27 03:36:22 user nova-compute[72990]:     <video supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='modelType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cirrus</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vmvga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>qxl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>none</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>bochs</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>ramfb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </video>
Aug 27 03:36:22 user nova-compute[72990]:     <hostdev supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='mode'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>subsystem</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='startupPolicy'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>default</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>mandatory</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>requisite</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>optional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='subsysType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pci</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='capsType'/>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='pciBackend'/>
Aug 27 03:36:22 user nova-compute[72990]:     </hostdev>
Aug 27 03:36:22 user nova-compute[72990]:     <rng supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>random</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egd</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>builtin</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </rng>
Aug 27 03:36:22 user nova-compute[72990]:     <filesystem supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='driverType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>path</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>handle</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtiofs</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </filesystem>
Aug 27 03:36:22 user nova-compute[72990]:     <tpm supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-tis</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-crb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>passthrough</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>emulator</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </tpm>
Aug 27 03:36:22 user nova-compute[72990]:   </devices>
Aug 27 03:36:22 user nova-compute[72990]:   <features>
Aug 27 03:36:22 user nova-compute[72990]:     <gic supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     <vmcoreinfo supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <genid supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backingStoreInput supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backup supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <sev supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:   </features>
Aug 27 03:36:22 user nova-compute[72990]: </domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:  {{(pid=72990) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 27 03:36:22 user nova-compute[72990]: <domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 03:36:22 user nova-compute[72990]:   <domain>kvm</domain>
Aug 27 03:36:22 user nova-compute[72990]:   <machine>pc-q35-jammy</machine>
Aug 27 03:36:22 user nova-compute[72990]:   <arch>i686</arch>
Aug 27 03:36:22 user nova-compute[72990]:   <vcpu max='288'/>
Aug 27 03:36:22 user nova-compute[72990]:   <iothreads supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:   <os supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='firmware'/>
Aug 27 03:36:22 user nova-compute[72990]:     <loader supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>rom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pflash</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='readonly'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>yes</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='secure'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </loader>
Aug 27 03:36:22 user nova-compute[72990]:   </os>
Aug 27 03:36:22 user nova-compute[72990]:   <cpu>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-passthrough' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='hostPassthroughMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='maximum' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='maximumMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>on</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-model' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <vendor>Intel</vendor>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ss'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='vmx'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='pcid'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='hypervisor'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arat'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='umip'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='md-clear'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibpb'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibrs'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='erms'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='lm'/>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='custom' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>qemu64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>qemu32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>phenom</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>n270</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>kvm64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>kvm32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>coreduo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>core2duo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>athlon</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Westmere</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Snowridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Penryn</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G5</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G4</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G1</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Nehalem</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Rome</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Milan</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Dhyana</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cooperlake</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Conroe</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>486</model>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:   </cpu>
Aug 27 03:36:22 user nova-compute[72990]:   <memoryBacking supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='sourceType'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>file</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>anonymous</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>memfd</value>
Aug 27 03:36:22 user nova-compute[72990]:     </enum>
Aug 27 03:36:22 user nova-compute[72990]:   </memoryBacking>
Aug 27 03:36:22 user nova-compute[72990]:   <devices>
Aug 27 03:36:22 user nova-compute[72990]:     <disk supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='diskDevice'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>disk</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cdrom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>floppy</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>lun</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='bus'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>fdc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sata</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </disk>
Aug 27 03:36:22 user nova-compute[72990]:     <graphics supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sdl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vnc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>spice</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egl-headless</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </graphics>
Aug 27 03:36:22 user nova-compute[72990]:     <video supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='modelType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cirrus</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vmvga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>qxl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>none</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>bochs</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>ramfb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </video>
Aug 27 03:36:22 user nova-compute[72990]:     <hostdev supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='mode'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>subsystem</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='startupPolicy'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>default</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>mandatory</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>requisite</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>optional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='subsysType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pci</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='capsType'/>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='pciBackend'/>
Aug 27 03:36:22 user nova-compute[72990]:     </hostdev>
Aug 27 03:36:22 user nova-compute[72990]:     <rng supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>random</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egd</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>builtin</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </rng>
Aug 27 03:36:22 user nova-compute[72990]:     <filesystem supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='driverType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>path</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>handle</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtiofs</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </filesystem>
Aug 27 03:36:22 user nova-compute[72990]:     <tpm supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-tis</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-crb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>passthrough</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>emulator</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </tpm>
Aug 27 03:36:22 user nova-compute[72990]:   </devices>
Aug 27 03:36:22 user nova-compute[72990]:   <features>
Aug 27 03:36:22 user nova-compute[72990]:     <gic supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     <vmcoreinfo supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <genid supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backingStoreInput supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backup supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <sev supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:   </features>
Aug 27 03:36:22 user nova-compute[72990]: </domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:  {{(pid=72990) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 27 03:36:22 user nova-compute[72990]: <domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 03:36:22 user nova-compute[72990]:   <domain>kvm</domain>
Aug 27 03:36:22 user nova-compute[72990]:   <machine>pc-i440fx-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:   <arch>i686</arch>
Aug 27 03:36:22 user nova-compute[72990]:   <vcpu max='255'/>
Aug 27 03:36:22 user nova-compute[72990]:   <iothreads supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:   <os supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='firmware'/>
Aug 27 03:36:22 user nova-compute[72990]:     <loader supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>rom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pflash</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='readonly'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>yes</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='secure'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </loader>
Aug 27 03:36:22 user nova-compute[72990]:   </os>
Aug 27 03:36:22 user nova-compute[72990]:   <cpu>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-passthrough' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='hostPassthroughMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='maximum' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='maximumMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>on</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-model' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <vendor>Intel</vendor>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ss'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='vmx'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='pcid'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='hypervisor'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arat'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='umip'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='md-clear'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibpb'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibrs'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='erms'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='lm'/>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='custom' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>qemu64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>qemu32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>phenom</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>n270</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>kvm64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>kvm32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>coreduo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>core2duo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>athlon</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Westmere</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Snowridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Penryn</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G5</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G4</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G1</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Nehalem</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Rome</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Milan</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Dhyana</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cooperlake</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Conroe</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>486</model>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:   </cpu>
Aug 27 03:36:22 user nova-compute[72990]:   <memoryBacking supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='sourceType'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>file</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>anonymous</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>memfd</value>
Aug 27 03:36:22 user nova-compute[72990]:     </enum>
Aug 27 03:36:22 user nova-compute[72990]:   </memoryBacking>
Aug 27 03:36:22 user nova-compute[72990]:   <devices>
Aug 27 03:36:22 user nova-compute[72990]:     <disk supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='diskDevice'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>disk</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cdrom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>floppy</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>lun</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='bus'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>ide</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>fdc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sata</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </disk>
Aug 27 03:36:22 user nova-compute[72990]:     <graphics supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sdl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vnc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>spice</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egl-headless</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </graphics>
Aug 27 03:36:22 user nova-compute[72990]:     <video supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='modelType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cirrus</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vmvga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>qxl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>none</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>bochs</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>ramfb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </video>
Aug 27 03:36:22 user nova-compute[72990]:     <hostdev supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='mode'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>subsystem</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='startupPolicy'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>default</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>mandatory</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>requisite</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>optional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='subsysType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pci</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='capsType'/>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='pciBackend'/>
Aug 27 03:36:22 user nova-compute[72990]:     </hostdev>
Aug 27 03:36:22 user nova-compute[72990]:     <rng supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>random</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egd</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>builtin</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </rng>
Aug 27 03:36:22 user nova-compute[72990]:     <filesystem supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='driverType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>path</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>handle</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtiofs</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </filesystem>
Aug 27 03:36:22 user nova-compute[72990]:     <tpm supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-tis</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-crb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>passthrough</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>emulator</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </tpm>
Aug 27 03:36:22 user nova-compute[72990]:   </devices>
Aug 27 03:36:22 user nova-compute[72990]:   <features>
Aug 27 03:36:22 user nova-compute[72990]:     <gic supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     <vmcoreinfo supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <genid supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backingStoreInput supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backup supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <sev supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:   </features>
Aug 27 03:36:22 user nova-compute[72990]: </domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:  {{(pid=72990) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 27 03:36:22 user nova-compute[72990]: <domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 03:36:22 user nova-compute[72990]:   <domain>kvm</domain>
Aug 27 03:36:22 user nova-compute[72990]:   <machine>pc-i440fx-jammy</machine>
Aug 27 03:36:22 user nova-compute[72990]:   <arch>x86_64</arch>
Aug 27 03:36:22 user nova-compute[72990]:   <vcpu max='255'/>
Aug 27 03:36:22 user nova-compute[72990]:   <iothreads supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:   <os supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='firmware'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>efi</value>
Aug 27 03:36:22 user nova-compute[72990]:     </enum>
Aug 27 03:36:22 user nova-compute[72990]:     <loader supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>rom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pflash</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='readonly'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>yes</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='secure'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </loader>
Aug 27 03:36:22 user nova-compute[72990]:   </os>
Aug 27 03:36:22 user nova-compute[72990]:   <cpu>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-passthrough' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='hostPassthroughMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>on</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='maximum' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='maximumMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>on</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-model' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <vendor>Intel</vendor>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ss'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='vmx'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='pcid'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='hypervisor'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arat'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='umip'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='md-clear'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='invtsc'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibpb'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibrs'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='rsba'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='erms'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='custom' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>qemu64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>qemu32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>phenom</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>n270</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>kvm64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>kvm32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>coreduo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>core2duo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>athlon</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Westmere</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Snowridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Penryn</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G5</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G4</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Opteron_G1</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Nehalem</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Rome</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Milan</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Dhyana</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cooperlake</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Conroe</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>486</model>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:   </cpu>
Aug 27 03:36:22 user nova-compute[72990]:   <memoryBacking supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='sourceType'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>file</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>anonymous</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>memfd</value>
Aug 27 03:36:22 user nova-compute[72990]:     </enum>
Aug 27 03:36:22 user nova-compute[72990]:   </memoryBacking>
Aug 27 03:36:22 user nova-compute[72990]:   <devices>
Aug 27 03:36:22 user nova-compute[72990]:     <disk supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='diskDevice'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>disk</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cdrom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>floppy</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>lun</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='bus'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>ide</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>fdc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sata</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </disk>
Aug 27 03:36:22 user nova-compute[72990]:     <graphics supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sdl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vnc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>spice</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egl-headless</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </graphics>
Aug 27 03:36:22 user nova-compute[72990]:     <video supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='modelType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cirrus</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vmvga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>qxl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>none</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>bochs</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>ramfb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </video>
Aug 27 03:36:22 user nova-compute[72990]:     <hostdev supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='mode'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>subsystem</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='startupPolicy'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>default</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>mandatory</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>requisite</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>optional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='subsysType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pci</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='capsType'/>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='pciBackend'/>
Aug 27 03:36:22 user nova-compute[72990]:     </hostdev>
Aug 27 03:36:22 user nova-compute[72990]:     <rng supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>random</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egd</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>builtin</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </rng>
Aug 27 03:36:22 user nova-compute[72990]:     <filesystem supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='driverType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>path</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>handle</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtiofs</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </filesystem>
Aug 27 03:36:22 user nova-compute[72990]:     <tpm supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-tis</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-crb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>passthrough</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>emulator</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </tpm>
Aug 27 03:36:22 user nova-compute[72990]:   </devices>
Aug 27 03:36:22 user nova-compute[72990]:   <features>
Aug 27 03:36:22 user nova-compute[72990]:     <gic supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     <vmcoreinfo supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <genid supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backingStoreInput supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backup supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <sev supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:   </features>
Aug 27 03:36:22 user nova-compute[72990]: </domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:  {{(pid=72990) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 27 03:36:22 user nova-compute[72990]: <domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 03:36:22 user nova-compute[72990]:   <domain>kvm</domain>
Aug 27 03:36:22 user nova-compute[72990]:   <machine>pc-q35-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:   <arch>x86_64</arch>
Aug 27 03:36:22 user nova-compute[72990]:   <vcpu max='288'/>
Aug 27 03:36:22 user nova-compute[72990]:   <iothreads supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:   <os supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='firmware'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>efi</value>
Aug 27 03:36:22 user nova-compute[72990]:     </enum>
Aug 27 03:36:22 user nova-compute[72990]:     <loader supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>rom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pflash</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='readonly'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>yes</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='secure'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>yes</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </loader>
Aug 27 03:36:22 user nova-compute[72990]:   </os>
Aug 27 03:36:22 user nova-compute[72990]:   <cpu>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-passthrough' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='hostPassthroughMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>on</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='maximum' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='maximumMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>on</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-model' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <vendor>Intel</vendor>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ss'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='vmx'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='pcid'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='hypervisor'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arat'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='umip'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='md-clear'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='invtsc'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibpb'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibrs'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='rsba'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='erms'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='custom' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>qemu64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>qemu32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>phenom</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>n270</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>kvm64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>kvm32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>coreduo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>core2duo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>athlon</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Westmere</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Snowridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Penryn</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G5</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G4</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Opteron_G1</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Nehalem</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Rome</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Milan</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Dhyana</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cooperlake</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Conroe</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>486</model>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:   </cpu>
Aug 27 03:36:22 user nova-compute[72990]:   <memoryBacking supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='sourceType'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>file</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>anonymous</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>memfd</value>
Aug 27 03:36:22 user nova-compute[72990]:     </enum>
Aug 27 03:36:22 user nova-compute[72990]:   </memoryBacking>
Aug 27 03:36:22 user nova-compute[72990]:   <devices>
Aug 27 03:36:22 user nova-compute[72990]:     <disk supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='diskDevice'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>disk</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cdrom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>floppy</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>lun</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='bus'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>fdc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sata</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </disk>
Aug 27 03:36:22 user nova-compute[72990]:     <graphics supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sdl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vnc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>spice</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egl-headless</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </graphics>
Aug 27 03:36:22 user nova-compute[72990]:     <video supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='modelType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cirrus</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vmvga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>qxl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>none</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>bochs</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>ramfb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </video>
Aug 27 03:36:22 user nova-compute[72990]:     <hostdev supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='mode'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>subsystem</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='startupPolicy'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>default</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>mandatory</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>requisite</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>optional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='subsysType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pci</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='capsType'/>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='pciBackend'/>
Aug 27 03:36:22 user nova-compute[72990]:     </hostdev>
Aug 27 03:36:22 user nova-compute[72990]:     <rng supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>random</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egd</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>builtin</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </rng>
Aug 27 03:36:22 user nova-compute[72990]:     <filesystem supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='driverType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>path</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>handle</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtiofs</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </filesystem>
Aug 27 03:36:22 user nova-compute[72990]:     <tpm supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-tis</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-crb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>passthrough</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>emulator</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </tpm>
Aug 27 03:36:22 user nova-compute[72990]:   </devices>
Aug 27 03:36:22 user nova-compute[72990]:   <features>
Aug 27 03:36:22 user nova-compute[72990]:     <gic supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     <vmcoreinfo supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <genid supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backingStoreInput supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backup supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <sev supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:   </features>
Aug 27 03:36:22 user nova-compute[72990]: </domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:  {{(pid=72990) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 27 03:36:22 user nova-compute[72990]: <domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 03:36:22 user nova-compute[72990]:   <domain>kvm</domain>
Aug 27 03:36:22 user nova-compute[72990]:   <machine>pc-q35-jammy</machine>
Aug 27 03:36:22 user nova-compute[72990]:   <arch>x86_64</arch>
Aug 27 03:36:22 user nova-compute[72990]:   <vcpu max='288'/>
Aug 27 03:36:22 user nova-compute[72990]:   <iothreads supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:   <os supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='firmware'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>efi</value>
Aug 27 03:36:22 user nova-compute[72990]:     </enum>
Aug 27 03:36:22 user nova-compute[72990]:     <loader supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>rom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pflash</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='readonly'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>yes</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='secure'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>yes</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </loader>
Aug 27 03:36:22 user nova-compute[72990]:   </os>
Aug 27 03:36:22 user nova-compute[72990]:   <cpu>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-passthrough' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='hostPassthroughMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>on</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='maximum' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='maximumMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>on</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-model' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <vendor>Intel</vendor>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ss'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='vmx'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='pcid'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='hypervisor'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arat'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='umip'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='md-clear'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='invtsc'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibpb'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibrs'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='rsba'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='erms'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='custom' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>qemu64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>qemu32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>phenom</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>n270</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>kvm64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>kvm32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>coreduo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>core2duo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>athlon</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Westmere</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Snowridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Penryn</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G5</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G4</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Opteron_G1</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Nehalem</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Rome</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Milan</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Dhyana</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cooperlake</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Conroe</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>486</model>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:   </cpu>
Aug 27 03:36:22 user nova-compute[72990]:   <memoryBacking supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='sourceType'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>file</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>anonymous</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>memfd</value>
Aug 27 03:36:22 user nova-compute[72990]:     </enum>
Aug 27 03:36:22 user nova-compute[72990]:   </memoryBacking>
Aug 27 03:36:22 user nova-compute[72990]:   <devices>
Aug 27 03:36:22 user nova-compute[72990]:     <disk supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='diskDevice'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>disk</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cdrom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>floppy</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>lun</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='bus'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>fdc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sata</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </disk>
Aug 27 03:36:22 user nova-compute[72990]:     <graphics supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sdl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vnc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>spice</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egl-headless</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </graphics>
Aug 27 03:36:22 user nova-compute[72990]:     <video supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='modelType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cirrus</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vmvga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>qxl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>none</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>bochs</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>ramfb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </video>
Aug 27 03:36:22 user nova-compute[72990]:     <hostdev supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='mode'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>subsystem</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='startupPolicy'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>default</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>mandatory</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>requisite</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>optional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='subsysType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pci</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='capsType'/>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='pciBackend'/>
Aug 27 03:36:22 user nova-compute[72990]:     </hostdev>
Aug 27 03:36:22 user nova-compute[72990]:     <rng supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>random</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egd</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>builtin</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </rng>
Aug 27 03:36:22 user nova-compute[72990]:     <filesystem supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='driverType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>path</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>handle</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtiofs</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </filesystem>
Aug 27 03:36:22 user nova-compute[72990]:     <tpm supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-tis</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-crb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>passthrough</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>emulator</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </tpm>
Aug 27 03:36:22 user nova-compute[72990]:   </devices>
Aug 27 03:36:22 user nova-compute[72990]:   <features>
Aug 27 03:36:22 user nova-compute[72990]:     <gic supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     <vmcoreinfo supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <genid supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backingStoreInput supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backup supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <sev supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:   </features>
Aug 27 03:36:22 user nova-compute[72990]: </domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:  {{(pid=72990) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 27 03:36:22 user nova-compute[72990]: <domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 03:36:22 user nova-compute[72990]:   <domain>kvm</domain>
Aug 27 03:36:22 user nova-compute[72990]:   <machine>pc-i440fx-6.2</machine>
Aug 27 03:36:22 user nova-compute[72990]:   <arch>x86_64</arch>
Aug 27 03:36:22 user nova-compute[72990]:   <vcpu max='255'/>
Aug 27 03:36:22 user nova-compute[72990]:   <iothreads supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:   <os supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='firmware'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>efi</value>
Aug 27 03:36:22 user nova-compute[72990]:     </enum>
Aug 27 03:36:22 user nova-compute[72990]:     <loader supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>rom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pflash</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='readonly'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>yes</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='secure'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>no</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </loader>
Aug 27 03:36:22 user nova-compute[72990]:   </os>
Aug 27 03:36:22 user nova-compute[72990]:   <cpu>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-passthrough' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='hostPassthroughMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>on</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='maximum' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='maximumMigratable'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>on</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>off</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='host-model' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <vendor>Intel</vendor>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ss'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='vmx'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='pcid'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='hypervisor'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arat'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='umip'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='md-clear'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='invtsc'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibpb'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='ibrs'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-stibp'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='rsba'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='erms'/>
Aug 27 03:36:22 user nova-compute[72990]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:     <mode name='custom' supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>qemu64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>qemu32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>phenom</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>pentium</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>n270</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>kvm64</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>kvm32</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>coreduo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>core2duo</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>athlon</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Westmere</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Snowridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Skylake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>SandyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Penryn</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G5</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G4</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G3</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Opteron_G2</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Opteron_G1</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Nehalem</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>IvyBridge</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Icelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Haswell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Rome</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-Milan</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>EPYC</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Dhyana</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cooperlake</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>Conroe</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='no'>Broadwell</model>
Aug 27 03:36:22 user nova-compute[72990]:       <model usable='yes'>486</model>
Aug 27 03:36:22 user nova-compute[72990]:     </mode>
Aug 27 03:36:22 user nova-compute[72990]:   </cpu>
Aug 27 03:36:22 user nova-compute[72990]:   <memoryBacking supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:     <enum name='sourceType'>
Aug 27 03:36:22 user nova-compute[72990]:       <value>file</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>anonymous</value>
Aug 27 03:36:22 user nova-compute[72990]:       <value>memfd</value>
Aug 27 03:36:22 user nova-compute[72990]:     </enum>
Aug 27 03:36:22 user nova-compute[72990]:   </memoryBacking>
Aug 27 03:36:22 user nova-compute[72990]:   <devices>
Aug 27 03:36:22 user nova-compute[72990]:     <disk supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='diskDevice'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>disk</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cdrom</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>floppy</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>lun</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='bus'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>ide</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>fdc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sata</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </disk>
Aug 27 03:36:22 user nova-compute[72990]:     <graphics supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='type'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>sdl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vnc</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>spice</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egl-headless</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </graphics>
Aug 27 03:36:22 user nova-compute[72990]:     <video supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='modelType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>cirrus</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>vmvga</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>qxl</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>none</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>bochs</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>ramfb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </video>
Aug 27 03:36:22 user nova-compute[72990]:     <hostdev supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='mode'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>subsystem</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='startupPolicy'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>default</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>mandatory</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>requisite</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>optional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='subsysType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>usb</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>pci</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>scsi</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='capsType'/>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='pciBackend'/>
Aug 27 03:36:22 user nova-compute[72990]:     </hostdev>
Aug 27 03:36:22 user nova-compute[72990]:     <rng supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtio-non-transitional</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>random</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>egd</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>builtin</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </rng>
Aug 27 03:36:22 user nova-compute[72990]:     <filesystem supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='driverType'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>path</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>handle</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>virtiofs</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </filesystem>
Aug 27 03:36:22 user nova-compute[72990]:     <tpm supported='yes'>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='model'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-tis</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>tpm-crb</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:       <enum name='backendModel'>
Aug 27 03:36:22 user nova-compute[72990]:         <value>passthrough</value>
Aug 27 03:36:22 user nova-compute[72990]:         <value>emulator</value>
Aug 27 03:36:22 user nova-compute[72990]:       </enum>
Aug 27 03:36:22 user nova-compute[72990]:     </tpm>
Aug 27 03:36:22 user nova-compute[72990]:   </devices>
Aug 27 03:36:22 user nova-compute[72990]:   <features>
Aug 27 03:36:22 user nova-compute[72990]:     <gic supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:     <vmcoreinfo supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <genid supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backingStoreInput supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <backup supported='yes'/>
Aug 27 03:36:22 user nova-compute[72990]:     <sev supported='no'/>
Aug 27 03:36:22 user nova-compute[72990]:   </features>
Aug 27 03:36:22 user nova-compute[72990]: </domainCapabilities>
Aug 27 03:36:22 user nova-compute[72990]:  {{(pid=72990) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72990) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72990) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Checking secure boot support for host arch (x86_64) {{(pid=72990) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Checking secure boot support for host arch (x86_64) {{(pid=72990) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Checking secure boot support for host arch (x86_64) {{(pid=72990) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 27 03:36:22 user nova-compute[72990]: INFO nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Secure Boot support detected
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] cpu compare xml: <cpu match="exact">
Aug 27 03:36:22 user nova-compute[72990]:   <model>Nehalem</model>
Aug 27 03:36:22 user nova-compute[72990]: </cpu>
Aug 27 03:36:22 user nova-compute[72990]:  {{(pid=72990) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 27 03:36:22 user nova-compute[72990]: INFO nova.virt.node [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Generated node identity 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba
Aug 27 03:36:22 user nova-compute[72990]: INFO nova.virt.node [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Wrote node identity 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba to /opt/stack/data/nova/compute_id
Aug 27 03:36:22 user nova-compute[72990]: WARNING nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Compute nodes ['404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 27 03:36:22 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 27 03:36:22 user nova-compute[72990]: WARNING nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 27 03:36:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:36:22 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:36:23 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:36:23 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Hypervisor/Node resource view: name=user free_ram=10891MB free_disk=26.237361907958984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:36:23 user nova-compute[72990]: WARNING nova.compute.resource_tracker [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] No compute node record for user:404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba could not be found.
Aug 27 03:36:23 user nova-compute[72990]: INFO nova.compute.resource_tracker [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Compute node record created for user:user with uuid: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:36:23 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [req-b77acb17-1dc4-4ecd-9b6f-acf9a8e39a7e] Created resource provider record via placement API for resource provider with UUID 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba and name user.
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72990) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 27 03:36:23 user nova-compute[72990]: INFO nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] kernel doesn't support AMD SEV
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Updating inventory in ProviderTree for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Libvirt baseline CPU <cpu>
Aug 27 03:36:23 user nova-compute[72990]:   <arch>x86_64</arch>
Aug 27 03:36:23 user nova-compute[72990]:   <model>Nehalem</model>
Aug 27 03:36:23 user nova-compute[72990]:   <vendor>Intel</vendor>
Aug 27 03:36:23 user nova-compute[72990]:   <topology sockets="6" cores="1" threads="1"/>
Aug 27 03:36:23 user nova-compute[72990]: </cpu>
Aug 27 03:36:23 user nova-compute[72990]:  {{(pid=72990) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Updated inventory for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Updating resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba generation from 0 to 1 during operation: update_inventory {{(pid=72990) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Updating inventory in ProviderTree for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Updating resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba generation from 1 to 2 during operation: update_traits {{(pid=72990) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.service [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Creating RPC server for service compute {{(pid=72990) start /opt/stack/nova/nova/service.py:182}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.service [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Join ServiceGroup membership for this service compute {{(pid=72990) start /opt/stack/nova/nova/service.py:199}}
Aug 27 03:36:23 user nova-compute[72990]: DEBUG nova.servicegroup.drivers.db [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72990) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 27 03:36:44 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:36:44 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Didn't find any instances for network info cache update. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:37:14 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:37:14 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:37:14 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=10272MB free_disk=26.14099884033203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:37:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:37:15 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:37:15 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:37:15 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:37:15 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:37:15 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:37:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:38:15 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:38:15 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:38:15 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=10212MB free_disk=26.187129974365234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:38:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:38:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:38:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:38:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:38:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:38:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:38:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 03:38:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Didn't find any instances for network info cache update. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 03:38:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:38:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:38:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:39:15 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:39:16 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:39:16 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:39:16 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=10194MB free_disk=25.97134017944336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:39:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:39:17 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:39:17 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:39:17 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:39:17 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:39:17 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:39:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:39:19 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:39:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:39:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 03:39:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Didn't find any instances for network info cache update. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 03:40:15 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:40:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:40:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:40:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:40:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:40:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:16 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:40:17 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:17 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:17 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=9493MB free_disk=25.994583129882812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:40:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:17 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:40:17 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:40:17 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:40:17 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:40:17 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:40:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:18 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:40:18 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:40:18 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:40:18 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:40:18 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:40:20 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:40:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:40:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 03:40:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Didn't find any instances for network info cache update. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 03:40:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ca203604-996d-4558-9857-df9e2001c319" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:40:23 user nova-compute[72990]: INFO nova.compute.claims [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Claim successful on node user
Aug 27 03:40:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "034cb1d6-25b5-499d-81b1-36adf2385242" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "034cb1d6-25b5-499d-81b1-36adf2385242" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.083s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:40:23 user nova-compute[72990]: INFO nova.compute.claims [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Claim successful on node user
Aug 27 03:40:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:40:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:40:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:40:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:40:24 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Creating image(s)
Aug 27 03:40:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "/opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "/opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:40:24 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:40:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:40:24 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Creating image(s)
Aug 27 03:40:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "/opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "/opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "/opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG nova.policy [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0631ab8ad8648e2912d4e554fbbe195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567ed48c72c547c6984851d6ba37e780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:40:24 user nova-compute[72990]: DEBUG nova.policy [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '858a63e8d5964f38ad776985cfbe9121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183297ba5b6549fdb39f2135d92b3794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:40:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8.part --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8.part --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:25 user nova-compute[72990]: DEBUG nova.virt.images [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] a49a9f69-b2fa-42fe-942e-afa347d26054 was qcow2, converting to raw {{(pid=72990) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 03:40:25 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:40:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8.part /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8.converted {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8.part /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8.converted" returned: 0 in 0.388s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8.converted --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.274s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:26 user nova-compute[72990]: INFO oslo.privsep.daemon [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpisjadmut/privsep.sock']
Aug 27 03:40:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.861s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:26 user sudo[82281]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpisjadmut/privsep.sock
Aug 27 03:40:26 user sudo[82281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 03:40:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:40:26 user nova-compute[72990]: INFO nova.compute.claims [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Claim successful on node user
Aug 27 03:40:26 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:40:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:40:27 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:40:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:40:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:40:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:40:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:40:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Creating image(s)
Aug 27 03:40:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "/opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "/opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:27 user nova-compute[72990]: DEBUG nova.policy [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0631ab8ad8648e2912d4e554fbbe195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567ed48c72c547c6984851d6ba37e780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:40:27 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Successfully created port: 4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:40:28 user sudo[82281]: pam_unix(sudo:session): session closed for user root
Aug 27 03:40:28 user nova-compute[72990]: INFO oslo.privsep.daemon [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Spawned new privsep daemon via rootwrap
Aug 27 03:40:28 user nova-compute[72990]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 03:40:28 user nova-compute[72990]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 03:40:28 user nova-compute[72990]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 27 03:40:28 user nova-compute[72990]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82286
Aug 27 03:40:28 user nova-compute[72990]: DEBUG nova.network.neutron [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Successfully created port: 372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:40:28 user nova-compute[72990]: WARNING oslo_privsep.priv_context [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] privsep daemon already running
Aug 27 03:40:28 user nova-compute[72990]: WARNING oslo_privsep.priv_context [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] privsep daemon already running
Aug 27 03:40:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.218s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.228s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk 1073741824" returned: 0 in 0.057s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.243s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Checking if we can resize image /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.207s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk 1073741824" returned: 0 in 0.093s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.585s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Cannot resize image /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Ensure instance console log exists: /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.296s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.346s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk 1073741824" returned: 0 in 0.068s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.376s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Cannot resize image /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Ensure instance console log exists: /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Cannot resize image /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Ensure instance console log exists: /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG nova.network.neutron [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Successfully updated port: 372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquired lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG nova.network.neutron [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Successfully created port: eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:40:30 user nova-compute[72990]: DEBUG nova.network.neutron [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-ad4b43c1-4d4e-4fa9-8b5e-0611b961d7e2 req-1bc2e3cb-fd93-4ca7-bd2e-b49726175a1f service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-changed-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-ad4b43c1-4d4e-4fa9-8b5e-0611b961d7e2 req-1bc2e3cb-fd93-4ca7-bd2e-b49726175a1f service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Refreshing instance network info cache due to event network-changed-372aa0cf-2e3f-47db-a433-7ed673f37dd0. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ad4b43c1-4d4e-4fa9-8b5e-0611b961d7e2 req-1bc2e3cb-fd93-4ca7-bd2e-b49726175a1f service nova] Acquiring lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.network.neutron [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Updating instance_info_cache with network_info: [{"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Releasing lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.compute.manager [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Instance network_info: |[{"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ad4b43c1-4d4e-4fa9-8b5e-0611b961d7e2 req-1bc2e3cb-fd93-4ca7-bd2e-b49726175a1f service nova] Acquired lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.network.neutron [req-ad4b43c1-4d4e-4fa9-8b5e-0611b961d7e2 req-1bc2e3cb-fd93-4ca7-bd2e-b49726175a1f service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Refreshing network info cache for port 372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Start _get_guest_xml network_info=[{"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:40:31 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:31 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:40:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1768289849',display_name='tempest-ServerRescueNegativeTestJSON-server-1768289849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1768289849',id=1,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='567ed48c72c547c6984851d6ba37e780',ramdisk_id='',reservation_id='r-nlz0jlc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-311406621',owner_user_name='tempest-ServerRescueNegativeTestJSON-311406621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:24Z,user_data=None,user_id='f0631ab8ad8648e2912d4e554fbbe195',uuid=ca203604-996d-4558-9857-df9e2001c319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converting VIF {"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:66:7d,bridge_name='br-int',has_traffic_filtering=True,id=372aa0cf-2e3f-47db-a433-7ed673f37dd0,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372aa0cf-2e') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG nova.objects.instance [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'pci_devices' on Instance uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:40:32 user nova-compute[72990]:   <uuid>ca203604-996d-4558-9857-df9e2001c319</uuid>
Aug 27 03:40:32 user nova-compute[72990]:   <name>instance-00000001</name>
Aug 27 03:40:32 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:40:32 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:40:32 user nova-compute[72990]:   <metadata>
Aug 27 03:40:32 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:40:32 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:40:32 user nova-compute[72990]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1768289849</nova:name>
Aug 27 03:40:32 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:40:31</nova:creationTime>
Aug 27 03:40:32 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:40:32 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:40:32 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:40:32 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:40:32 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:40:32 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:40:32 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:40:32 user nova-compute[72990]:       <nova:owner>
Aug 27 03:40:32 user nova-compute[72990]:         <nova:user uuid="f0631ab8ad8648e2912d4e554fbbe195">tempest-ServerRescueNegativeTestJSON-311406621-project-member</nova:user>
Aug 27 03:40:32 user nova-compute[72990]:         <nova:project uuid="567ed48c72c547c6984851d6ba37e780">tempest-ServerRescueNegativeTestJSON-311406621</nova:project>
Aug 27 03:40:32 user nova-compute[72990]:       </nova:owner>
Aug 27 03:40:32 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:40:32 user nova-compute[72990]:       <nova:ports>
Aug 27 03:40:32 user nova-compute[72990]:         <nova:port uuid="372aa0cf-2e3f-47db-a433-7ed673f37dd0">
Aug 27 03:40:32 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 03:40:32 user nova-compute[72990]:         </nova:port>
Aug 27 03:40:32 user nova-compute[72990]:       </nova:ports>
Aug 27 03:40:32 user nova-compute[72990]:     </nova:instance>
Aug 27 03:40:32 user nova-compute[72990]:   </metadata>
Aug 27 03:40:32 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:40:32 user nova-compute[72990]:     <system>
Aug 27 03:40:32 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:40:32 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:40:32 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:40:32 user nova-compute[72990]:       <entry name="serial">ca203604-996d-4558-9857-df9e2001c319</entry>
Aug 27 03:40:32 user nova-compute[72990]:       <entry name="uuid">ca203604-996d-4558-9857-df9e2001c319</entry>
Aug 27 03:40:32 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:40:32 user nova-compute[72990]:     </system>
Aug 27 03:40:32 user nova-compute[72990]:   </sysinfo>
Aug 27 03:40:32 user nova-compute[72990]:   <os>
Aug 27 03:40:32 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:40:32 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:40:32 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:40:32 user nova-compute[72990]:   </os>
Aug 27 03:40:32 user nova-compute[72990]:   <features>
Aug 27 03:40:32 user nova-compute[72990]:     <acpi/>
Aug 27 03:40:32 user nova-compute[72990]:     <apic/>
Aug 27 03:40:32 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:40:32 user nova-compute[72990]:   </features>
Aug 27 03:40:32 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:40:32 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:40:32 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:40:32 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:40:32 user nova-compute[72990]:   </clock>
Aug 27 03:40:32 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:40:32 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:40:32 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:40:32 user nova-compute[72990]:   </cpu>
Aug 27 03:40:32 user nova-compute[72990]:   <devices>
Aug 27 03:40:32 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:40:32 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:40:32 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk"/>
Aug 27 03:40:32 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:40:32 user nova-compute[72990]:     </disk>
Aug 27 03:40:32 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:40:32 user nova-compute[72990]:       <mac address="fa:16:3e:3c:66:7d"/>
Aug 27 03:40:32 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:40:32 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:40:32 user nova-compute[72990]:       <target dev="tap372aa0cf-2e"/>
Aug 27 03:40:32 user nova-compute[72990]:     </interface>
Aug 27 03:40:32 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:40:32 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/console.log" append="off"/>
Aug 27 03:40:32 user nova-compute[72990]:     </serial>
Aug 27 03:40:32 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:40:32 user nova-compute[72990]:     <video>
Aug 27 03:40:32 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:40:32 user nova-compute[72990]:     </video>
Aug 27 03:40:32 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:40:32 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:40:32 user nova-compute[72990]:     </rng>
Aug 27 03:40:32 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:40:32 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:40:32 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:40:32 user nova-compute[72990]:     </memballoon>
Aug 27 03:40:32 user nova-compute[72990]:   </devices>
Aug 27 03:40:32 user nova-compute[72990]: </domain>
Aug 27 03:40:32 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1768289849',display_name='tempest-ServerRescueNegativeTestJSON-server-1768289849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1768289849',id=1,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='567ed48c72c547c6984851d6ba37e780',ramdisk_id='',reservation_id='r-nlz0jlc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-311406621',owner_user_name='tempest-ServerRescueNegativeTestJSON-311406621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:24Z,user_data=None,user_id='f0631ab8ad8648e2912d4e554fbbe195',uuid=ca203604-996d-4558-9857-df9e2001c319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converting VIF {"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:66:7d,bridge_name='br-int',has_traffic_filtering=True,id=372aa0cf-2e3f-47db-a433-7ed673f37dd0,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372aa0cf-2e') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG os_vif [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:66:7d,bridge_name='br-int',has_traffic_filtering=True,id=372aa0cf-2e3f-47db-a433-7ed673f37dd0,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372aa0cf-2e') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Created schema index Interface.name {{(pid=72990) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Created schema index Port.name {{(pid=72990) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Created schema index Bridge.name {{(pid=72990) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [POLLOUT] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:40:32 user nova-compute[72990]: INFO oslo.privsep.daemon [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpgld9wjnh/privsep.sock']
Aug 27 03:40:32 user sudo[82337]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpgld9wjnh/privsep.sock
Aug 27 03:40:32 user sudo[82337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 03:40:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Successfully updated port: 4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquired lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:40:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:40:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-04634adf-472a-4310-ac11-fb0dbe1cc393 req-432857ac-8bed-4c25-ad97-73598788e7bc service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Received event network-changed-4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-04634adf-472a-4310-ac11-fb0dbe1cc393 req-432857ac-8bed-4c25-ad97-73598788e7bc service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Refreshing instance network info cache due to event network-changed-4f10397c-dcdf-4be9-8744-fe97b2046fab. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:40:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-04634adf-472a-4310-ac11-fb0dbe1cc393 req-432857ac-8bed-4c25-ad97-73598788e7bc service nova] Acquiring lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:40:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-ad4b43c1-4d4e-4fa9-8b5e-0611b961d7e2 req-1bc2e3cb-fd93-4ca7-bd2e-b49726175a1f service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Updated VIF entry in instance network info cache for port 372aa0cf-2e3f-47db-a433-7ed673f37dd0. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:40:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-ad4b43c1-4d4e-4fa9-8b5e-0611b961d7e2 req-1bc2e3cb-fd93-4ca7-bd2e-b49726175a1f service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Updating instance_info_cache with network_info: [{"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:40:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ad4b43c1-4d4e-4fa9-8b5e-0611b961d7e2 req-1bc2e3cb-fd93-4ca7-bd2e-b49726175a1f service nova] Releasing lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:40:33 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:40:34 user sudo[82337]: pam_unix(sudo:session): session closed for user root
Aug 27 03:40:34 user nova-compute[72990]: INFO oslo.privsep.daemon [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Spawned new privsep daemon via rootwrap
Aug 27 03:40:34 user nova-compute[72990]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 03:40:34 user nova-compute[72990]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 03:40:34 user nova-compute[72990]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 27 03:40:34 user nova-compute[72990]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82344
Aug 27 03:40:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap372aa0cf-2e, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap372aa0cf-2e, col_values=(('external_ids', {'iface-id': '372aa0cf-2e3f-47db-a433-7ed673f37dd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:66:7d', 'vm-uuid': 'ca203604-996d-4558-9857-df9e2001c319'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:40:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:34 user nova-compute[72990]: INFO os_vif [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:66:7d,bridge_name='br-int',has_traffic_filtering=True,id=372aa0cf-2e3f-47db-a433-7ed673f37dd0,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372aa0cf-2e')
Aug 27 03:40:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:40:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No VIF found with MAC fa:16:3e:3c:66:7d, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:40:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "7835f781-b543-4370-922b-3d2a76f9821b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:40:35 user nova-compute[72990]: INFO nova.compute.claims [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Claim successful on node user
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Updating instance_info_cache with network_info: [{"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Releasing lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Instance network_info: |[{"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-04634adf-472a-4310-ac11-fb0dbe1cc393 req-432857ac-8bed-4c25-ad97-73598788e7bc service nova] Acquired lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.network.neutron [req-04634adf-472a-4310-ac11-fb0dbe1cc393 req-432857ac-8bed-4c25-ad97-73598788e7bc service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Refreshing network info cache for port 4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Start _get_guest_xml network_info=[{"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:40:35 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:35 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-470204338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-470204338',id=2,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-c6b5r5n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:24Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=034cb1d6-25b5-499d-81b1-36adf2385242,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:bf:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f10397c-dcdf-4be9-8744-fe97b2046fab,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f10397c-dc') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'pci_devices' on Instance uuid 034cb1d6-25b5-499d-81b1-36adf2385242 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:40:35 user nova-compute[72990]:   <uuid>034cb1d6-25b5-499d-81b1-36adf2385242</uuid>
Aug 27 03:40:35 user nova-compute[72990]:   <name>instance-00000002</name>
Aug 27 03:40:35 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:40:35 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:40:35 user nova-compute[72990]:   <metadata>
Aug 27 03:40:35 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:40:35 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:40:35 user nova-compute[72990]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-470204338</nova:name>
Aug 27 03:40:35 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:40:35</nova:creationTime>
Aug 27 03:40:35 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:40:35 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:40:35 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:40:35 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:40:35 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:40:35 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:40:35 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:40:35 user nova-compute[72990]:       <nova:owner>
Aug 27 03:40:35 user nova-compute[72990]:         <nova:user uuid="858a63e8d5964f38ad776985cfbe9121">tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member</nova:user>
Aug 27 03:40:35 user nova-compute[72990]:         <nova:project uuid="183297ba5b6549fdb39f2135d92b3794">tempest-ServerBootFromVolumeStableRescueTest-1839224225</nova:project>
Aug 27 03:40:35 user nova-compute[72990]:       </nova:owner>
Aug 27 03:40:35 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:40:35 user nova-compute[72990]:       <nova:ports>
Aug 27 03:40:35 user nova-compute[72990]:         <nova:port uuid="4f10397c-dcdf-4be9-8744-fe97b2046fab">
Aug 27 03:40:35 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 03:40:35 user nova-compute[72990]:         </nova:port>
Aug 27 03:40:35 user nova-compute[72990]:       </nova:ports>
Aug 27 03:40:35 user nova-compute[72990]:     </nova:instance>
Aug 27 03:40:35 user nova-compute[72990]:   </metadata>
Aug 27 03:40:35 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:40:35 user nova-compute[72990]:     <system>
Aug 27 03:40:35 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:40:35 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:40:35 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:40:35 user nova-compute[72990]:       <entry name="serial">034cb1d6-25b5-499d-81b1-36adf2385242</entry>
Aug 27 03:40:35 user nova-compute[72990]:       <entry name="uuid">034cb1d6-25b5-499d-81b1-36adf2385242</entry>
Aug 27 03:40:35 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:40:35 user nova-compute[72990]:     </system>
Aug 27 03:40:35 user nova-compute[72990]:   </sysinfo>
Aug 27 03:40:35 user nova-compute[72990]:   <os>
Aug 27 03:40:35 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:40:35 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:40:35 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:40:35 user nova-compute[72990]:   </os>
Aug 27 03:40:35 user nova-compute[72990]:   <features>
Aug 27 03:40:35 user nova-compute[72990]:     <acpi/>
Aug 27 03:40:35 user nova-compute[72990]:     <apic/>
Aug 27 03:40:35 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:40:35 user nova-compute[72990]:   </features>
Aug 27 03:40:35 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:40:35 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:40:35 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:40:35 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:40:35 user nova-compute[72990]:   </clock>
Aug 27 03:40:35 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:40:35 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:40:35 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:40:35 user nova-compute[72990]:   </cpu>
Aug 27 03:40:35 user nova-compute[72990]:   <devices>
Aug 27 03:40:35 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:40:35 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:40:35 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk"/>
Aug 27 03:40:35 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:40:35 user nova-compute[72990]:     </disk>
Aug 27 03:40:35 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:40:35 user nova-compute[72990]:       <mac address="fa:16:3e:ea:bf:f0"/>
Aug 27 03:40:35 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:40:35 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:40:35 user nova-compute[72990]:       <target dev="tap4f10397c-dc"/>
Aug 27 03:40:35 user nova-compute[72990]:     </interface>
Aug 27 03:40:35 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:40:35 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/console.log" append="off"/>
Aug 27 03:40:35 user nova-compute[72990]:     </serial>
Aug 27 03:40:35 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:40:35 user nova-compute[72990]:     <video>
Aug 27 03:40:35 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:40:35 user nova-compute[72990]:     </video>
Aug 27 03:40:35 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:40:35 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:40:35 user nova-compute[72990]:     </rng>
Aug 27 03:40:35 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:40:35 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:40:35 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:40:35 user nova-compute[72990]:     </memballoon>
Aug 27 03:40:35 user nova-compute[72990]:   </devices>
Aug 27 03:40:35 user nova-compute[72990]: </domain>
Aug 27 03:40:35 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-470204338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-470204338',id=2,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-c6b5r5n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:24Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=034cb1d6-25b5-499d-81b1-36adf2385242,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:bf:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f10397c-dcdf-4be9-8744-fe97b2046fab,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f10397c-dc') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG os_vif [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:bf:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f10397c-dcdf-4be9-8744-fe97b2046fab,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f10397c-dc') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f10397c-dc, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f10397c-dc, col_values=(('external_ids', {'iface-id': '4f10397c-dcdf-4be9-8744-fe97b2046fab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:bf:f0', 'vm-uuid': '034cb1d6-25b5-499d-81b1-36adf2385242'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:35 user nova-compute[72990]: INFO os_vif [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:bf:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f10397c-dcdf-4be9-8744-fe97b2046fab,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f10397c-dc')
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No VIF found with MAC fa:16:3e:ea:bf:f0, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:40:35 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:40:35 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Creating image(s)
Aug 27 03:40:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "/opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "/opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "/opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG nova.policy [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5856ab8a362e440abcb62fdbc61f495b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37efbadb079847d6852574734e40de9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Successfully updated port: eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquired lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.221s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-7c3b3ea3-cea5-4eb5-8ac4-a331fb0dd15b req-9a574399-66be-4329-9ed7-a56a4b4b9cf0 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received event network-changed-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-7c3b3ea3-cea5-4eb5-8ac4-a331fb0dd15b req-9a574399-66be-4329-9ed7-a56a4b4b9cf0 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Refreshing instance network info cache due to event network-changed-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7c3b3ea3-cea5-4eb5-8ac4-a331fb0dd15b req-9a574399-66be-4329-9ed7-a56a4b4b9cf0 service nova] Acquiring lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk 1073741824" returned: 0 in 0.115s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.228s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "bcd09a59-c950-4143-bfc8-9a89705cca8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG nova.compute.manager [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Cannot resize image /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Ensure instance console log exists: /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:36 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:40:36 user nova-compute[72990]: INFO nova.compute.claims [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Claim successful on node user
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.network.neutron [req-04634adf-472a-4310-ac11-fb0dbe1cc393 req-432857ac-8bed-4c25-ad97-73598788e7bc service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Updated VIF entry in instance network info cache for port 4f10397c-dcdf-4be9-8744-fe97b2046fab. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.network.neutron [req-04634adf-472a-4310-ac11-fb0dbe1cc393 req-432857ac-8bed-4c25-ad97-73598788e7bc service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Updating instance_info_cache with network_info: [{"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-04634adf-472a-4310-ac11-fb0dbe1cc393 req-432857ac-8bed-4c25-ad97-73598788e7bc service nova] Releasing lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.network.neutron [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:40:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.policy [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb95e31732904174a8ebddf48c6426ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2282ed15ca724f029c368c8a5ce0f268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:40:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Creating image(s)
Aug 27 03:40:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "/opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "/opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Updating instance_info_cache with network_info: [{"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Releasing lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Instance network_info: |[{"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7c3b3ea3-cea5-4eb5-8ac4-a331fb0dd15b req-9a574399-66be-4329-9ed7-a56a4b4b9cf0 service nova] Acquired lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.network.neutron [req-7c3b3ea3-cea5-4eb5-8ac4-a331fb0dd15b req-9a574399-66be-4329-9ed7-a56a4b4b9cf0 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Refreshing network info cache for port eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Start _get_guest_xml network_info=[{"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:38 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:38 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-750776012',display_name='tempest-ServerRescueNegativeTestJSON-server-750776012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-750776012',id=3,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='567ed48c72c547c6984851d6ba37e780',ramdisk_id='',reservation_id='r-7it4e73j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-311406621',owner_user_name='tempest-ServerRescueNegativeTestJSON-311406621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:27Z,user_data=None,user_id='f0631ab8ad8648e2912d4e554fbbe195',uuid=8ff6c50a-eb4e-4d5a-a213-4fbd7598234f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converting VIF {"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:7e:fa,bridge_name='br-int',has_traffic_filtering=True,id=eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb0ae47f-f2') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:40:38 user nova-compute[72990]:   <uuid>8ff6c50a-eb4e-4d5a-a213-4fbd7598234f</uuid>
Aug 27 03:40:38 user nova-compute[72990]:   <name>instance-00000003</name>
Aug 27 03:40:38 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:40:38 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:40:38 user nova-compute[72990]:   <metadata>
Aug 27 03:40:38 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:40:38 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:40:38 user nova-compute[72990]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-750776012</nova:name>
Aug 27 03:40:38 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:40:38</nova:creationTime>
Aug 27 03:40:38 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:40:38 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:40:38 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:40:38 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:40:38 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:40:38 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:40:38 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:40:38 user nova-compute[72990]:       <nova:owner>
Aug 27 03:40:38 user nova-compute[72990]:         <nova:user uuid="f0631ab8ad8648e2912d4e554fbbe195">tempest-ServerRescueNegativeTestJSON-311406621-project-member</nova:user>
Aug 27 03:40:38 user nova-compute[72990]:         <nova:project uuid="567ed48c72c547c6984851d6ba37e780">tempest-ServerRescueNegativeTestJSON-311406621</nova:project>
Aug 27 03:40:38 user nova-compute[72990]:       </nova:owner>
Aug 27 03:40:38 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:40:38 user nova-compute[72990]:       <nova:ports>
Aug 27 03:40:38 user nova-compute[72990]:         <nova:port uuid="eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c">
Aug 27 03:40:38 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 03:40:38 user nova-compute[72990]:         </nova:port>
Aug 27 03:40:38 user nova-compute[72990]:       </nova:ports>
Aug 27 03:40:38 user nova-compute[72990]:     </nova:instance>
Aug 27 03:40:38 user nova-compute[72990]:   </metadata>
Aug 27 03:40:38 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:40:38 user nova-compute[72990]:     <system>
Aug 27 03:40:38 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:40:38 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:40:38 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:40:38 user nova-compute[72990]:       <entry name="serial">8ff6c50a-eb4e-4d5a-a213-4fbd7598234f</entry>
Aug 27 03:40:38 user nova-compute[72990]:       <entry name="uuid">8ff6c50a-eb4e-4d5a-a213-4fbd7598234f</entry>
Aug 27 03:40:38 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:40:38 user nova-compute[72990]:     </system>
Aug 27 03:40:38 user nova-compute[72990]:   </sysinfo>
Aug 27 03:40:38 user nova-compute[72990]:   <os>
Aug 27 03:40:38 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:40:38 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:40:38 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:40:38 user nova-compute[72990]:   </os>
Aug 27 03:40:38 user nova-compute[72990]:   <features>
Aug 27 03:40:38 user nova-compute[72990]:     <acpi/>
Aug 27 03:40:38 user nova-compute[72990]:     <apic/>
Aug 27 03:40:38 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:40:38 user nova-compute[72990]:   </features>
Aug 27 03:40:38 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:40:38 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:40:38 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:40:38 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:40:38 user nova-compute[72990]:   </clock>
Aug 27 03:40:38 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:40:38 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:40:38 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:40:38 user nova-compute[72990]:   </cpu>
Aug 27 03:40:38 user nova-compute[72990]:   <devices>
Aug 27 03:40:38 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:40:38 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:40:38 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk"/>
Aug 27 03:40:38 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:40:38 user nova-compute[72990]:     </disk>
Aug 27 03:40:38 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:40:38 user nova-compute[72990]:       <mac address="fa:16:3e:df:7e:fa"/>
Aug 27 03:40:38 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:40:38 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:40:38 user nova-compute[72990]:       <target dev="tapeb0ae47f-f2"/>
Aug 27 03:40:38 user nova-compute[72990]:     </interface>
Aug 27 03:40:38 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:40:38 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/console.log" append="off"/>
Aug 27 03:40:38 user nova-compute[72990]:     </serial>
Aug 27 03:40:38 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:40:38 user nova-compute[72990]:     <video>
Aug 27 03:40:38 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:40:38 user nova-compute[72990]:     </video>
Aug 27 03:40:38 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:40:38 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:40:38 user nova-compute[72990]:     </rng>
Aug 27 03:40:38 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:40:38 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:40:38 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:40:38 user nova-compute[72990]:     </memballoon>
Aug 27 03:40:38 user nova-compute[72990]:   </devices>
Aug 27 03:40:38 user nova-compute[72990]: </domain>
Aug 27 03:40:38 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-750776012',display_name='tempest-ServerRescueNegativeTestJSON-server-750776012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-750776012',id=3,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='567ed48c72c547c6984851d6ba37e780',ramdisk_id='',reservation_id='r-7it4e73j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-311406621',owner_user_name='tempest-ServerRescueNegativeTestJSON-311406621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:27Z,user_data=None,user_id='f0631ab8ad8648e2912d4e554fbbe195',uuid=8ff6c50a-eb4e-4d5a-a213-4fbd7598234f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converting VIF {"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:7e:fa,bridge_name='br-int',has_traffic_filtering=True,id=eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb0ae47f-f2') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG os_vif [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:7e:fa,bridge_name='br-int',has_traffic_filtering=True,id=eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb0ae47f-f2') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.218s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb0ae47f-f2, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb0ae47f-f2, col_values=(('external_ids', {'iface-id': 'eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:7e:fa', 'vm-uuid': '8ff6c50a-eb4e-4d5a-a213-4fbd7598234f'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:38 user nova-compute[72990]: INFO os_vif [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:7e:fa,bridge_name='br-int',has_traffic_filtering=True,id=eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb0ae47f-f2')
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk 1073741824" returned: 0 in 0.070s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No VIF found with MAC fa:16:3e:df:7e:fa, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Successfully created port: eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Cannot resize image /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Ensure instance console log exists: /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:40:38 user nova-compute[72990]: INFO nova.compute.claims [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Claim successful on node user
Aug 27 03:40:38 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:40:39 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:40:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG nova.network.neutron [req-7c3b3ea3-cea5-4eb5-8ac4-a331fb0dd15b req-9a574399-66be-4329-9ed7-a56a4b4b9cf0 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Updated VIF entry in instance network info cache for port eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG nova.network.neutron [req-7c3b3ea3-cea5-4eb5-8ac4-a331fb0dd15b req-9a574399-66be-4329-9ed7-a56a4b4b9cf0 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Updating instance_info_cache with network_info: [{"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7c3b3ea3-cea5-4eb5-8ac4-a331fb0dd15b req-9a574399-66be-4329-9ed7-a56a4b4b9cf0 service nova] Releasing lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:40:39 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Creating image(s)
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "/opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "/opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "/opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG nova.policy [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e7d2fc4d4204ad38d0d11376de45bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd007a65dbbce40729d2d7a25561a4f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Successfully created port: 7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.226s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk 1073741824" returned: 0 in 0.099s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107640.126644, ca203604-996d-4558-9857-df9e2001c319 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:40:40 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] VM Resumed (Lifecycle Event)
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:40:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: ca203604-996d-4558-9857-df9e2001c319] Instance spawned successfully.
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.265s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:40:40 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107640.1278617, ca203604-996d-4558-9857-df9e2001c319 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:40:40 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] VM Started (Lifecycle Event)
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Cannot resize image /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Ensure instance console log exists: /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:40 user nova-compute[72990]: INFO nova.compute.manager [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Took 16.42 seconds to spawn the instance on the hypervisor.
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:40 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:40:40 user nova-compute[72990]: INFO nova.compute.manager [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Took 17.60 seconds to build instance.
Aug 27 03:40:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-17415037-4a18-4f3c-a087-39f048900fc6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ca203604-996d-4558-9857-df9e2001c319" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.864s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Successfully updated port: eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquired lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-aba3a0f8-e378-4147-a815-dabf635cdd86 req-94b8d2cb-0eb2-432c-b074-c0622b03e0d2 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-changed-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-aba3a0f8-e378-4147-a815-dabf635cdd86 req-94b8d2cb-0eb2-432c-b074-c0622b03e0d2 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Refreshing instance network info cache due to event network-changed-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:40:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aba3a0f8-e378-4147-a815-dabf635cdd86 req-94b8d2cb-0eb2-432c-b074-c0622b03e0d2 service nova] Acquiring lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107641.4641643, 034cb1d6-25b5-499d-81b1-36adf2385242 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:40:41 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] VM Resumed (Lifecycle Event)
Aug 27 03:40:41 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Instance spawned successfully.
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:41 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107641.464872, 034cb1d6-25b5-499d-81b1-36adf2385242 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:40:41 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] VM Started (Lifecycle Event)
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:40:41 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Successfully created port: 11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:41 user nova-compute[72990]: INFO nova.compute.manager [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Took 17.21 seconds to spawn the instance on the hypervisor.
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:41 user nova-compute[72990]: INFO nova.compute.manager [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Took 18.29 seconds to build instance.
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Successfully updated port: 7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquired lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:40:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dfaf0bc0-4c01-405e-b422-15f2b4ff72ae tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "034cb1d6-25b5-499d-81b1-36adf2385242" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.529s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-67fa8bba-c854-452d-ad3e-b73ccf00f7bb req-a6296713-3b03-4c7e-a99a-4b69493c7aed service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Received event network-changed-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-67fa8bba-c854-452d-ad3e-b73ccf00f7bb req-a6296713-3b03-4c7e-a99a-4b69493c7aed service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Refreshing instance network info cache due to event network-changed-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-67fa8bba-c854-452d-ad3e-b73ccf00f7bb req-a6296713-3b03-4c7e-a99a-4b69493c7aed service nova] Acquiring lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107642.458387, 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:40:42 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] VM Resumed (Lifecycle Event)
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:40:42 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Instance spawned successfully.
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:40:42 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107642.4625, 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:40:42 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] VM Started (Lifecycle Event)
Aug 27 03:40:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Releasing lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Instance network_info: |[{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aba3a0f8-e378-4147-a815-dabf635cdd86 req-94b8d2cb-0eb2-432c-b074-c0622b03e0d2 service nova] Acquired lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.network.neutron [req-aba3a0f8-e378-4147-a815-dabf635cdd86 req-94b8d2cb-0eb2-432c-b074-c0622b03e0d2 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Refreshing network info cache for port eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Start _get_guest_xml network_info=[{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:40:42 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:42 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1426790154',display_name='tempest-ServerStableDeviceRescueTest-server-1426790154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1426790154',id=4,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuie8I1zmPTJR4MWFJd4uL9H7Y7zaw0i0/HxDbhxujiX8dZTY7PejDyY5i59a4QWzNZOOaKk6B+aPRfLvRmlc5NyO+hiXVGcLw0acVKee1aqH5Y4VgHEQo51OQ+4w65xg==',key_name='tempest-keypair-1407954263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37efbadb079847d6852574734e40de9a',ramdisk_id='',reservation_id='r-q7dxzftt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-181138782',owner_user_name='tempest-ServerStableDeviceRescueTest-181138782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5856ab8a362e440abcb62fdbc61f495b',uuid=7835f781-b543-4370-922b-3d2a76f9821b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Converting VIF {"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:62:6e,bridge_name='br-int',has_traffic_filtering=True,id=eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d,network=Network(58588dcd-f0f9-4efd-91b7-a15aeec22905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb08b4e3-74') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lazy-loading 'pci_devices' on Instance uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:40:42 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:40:42 user nova-compute[72990]: INFO nova.compute.manager [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Took 15.63 seconds to spawn the instance on the hypervisor.
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:40:42 user nova-compute[72990]:   <uuid>7835f781-b543-4370-922b-3d2a76f9821b</uuid>
Aug 27 03:40:42 user nova-compute[72990]:   <name>instance-00000004</name>
Aug 27 03:40:42 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:40:42 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:40:42 user nova-compute[72990]:   <metadata>
Aug 27 03:40:42 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:40:42 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:40:42 user nova-compute[72990]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1426790154</nova:name>
Aug 27 03:40:42 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:40:42</nova:creationTime>
Aug 27 03:40:42 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:40:42 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:40:42 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:40:42 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:40:42 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:40:42 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:40:42 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:40:42 user nova-compute[72990]:       <nova:owner>
Aug 27 03:40:42 user nova-compute[72990]:         <nova:user uuid="5856ab8a362e440abcb62fdbc61f495b">tempest-ServerStableDeviceRescueTest-181138782-project-member</nova:user>
Aug 27 03:40:42 user nova-compute[72990]:         <nova:project uuid="37efbadb079847d6852574734e40de9a">tempest-ServerStableDeviceRescueTest-181138782</nova:project>
Aug 27 03:40:42 user nova-compute[72990]:       </nova:owner>
Aug 27 03:40:42 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:40:42 user nova-compute[72990]:       <nova:ports>
Aug 27 03:40:42 user nova-compute[72990]:         <nova:port uuid="eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d">
Aug 27 03:40:42 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 03:40:42 user nova-compute[72990]:         </nova:port>
Aug 27 03:40:42 user nova-compute[72990]:       </nova:ports>
Aug 27 03:40:42 user nova-compute[72990]:     </nova:instance>
Aug 27 03:40:42 user nova-compute[72990]:   </metadata>
Aug 27 03:40:42 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:40:42 user nova-compute[72990]:     <system>
Aug 27 03:40:42 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:40:42 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:40:42 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:40:42 user nova-compute[72990]:       <entry name="serial">7835f781-b543-4370-922b-3d2a76f9821b</entry>
Aug 27 03:40:42 user nova-compute[72990]:       <entry name="uuid">7835f781-b543-4370-922b-3d2a76f9821b</entry>
Aug 27 03:40:42 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:40:42 user nova-compute[72990]:     </system>
Aug 27 03:40:42 user nova-compute[72990]:   </sysinfo>
Aug 27 03:40:42 user nova-compute[72990]:   <os>
Aug 27 03:40:42 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:40:42 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:40:42 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:40:42 user nova-compute[72990]:   </os>
Aug 27 03:40:42 user nova-compute[72990]:   <features>
Aug 27 03:40:42 user nova-compute[72990]:     <acpi/>
Aug 27 03:40:42 user nova-compute[72990]:     <apic/>
Aug 27 03:40:42 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:40:42 user nova-compute[72990]:   </features>
Aug 27 03:40:42 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:40:42 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:40:42 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:40:42 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:40:42 user nova-compute[72990]:   </clock>
Aug 27 03:40:42 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:40:42 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:40:42 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:40:42 user nova-compute[72990]:   </cpu>
Aug 27 03:40:42 user nova-compute[72990]:   <devices>
Aug 27 03:40:42 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:40:42 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:40:42 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk"/>
Aug 27 03:40:42 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:40:42 user nova-compute[72990]:     </disk>
Aug 27 03:40:42 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:40:42 user nova-compute[72990]:       <mac address="fa:16:3e:1c:62:6e"/>
Aug 27 03:40:42 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:40:42 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:40:42 user nova-compute[72990]:       <target dev="tapeb08b4e3-74"/>
Aug 27 03:40:42 user nova-compute[72990]:     </interface>
Aug 27 03:40:42 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:40:42 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/console.log" append="off"/>
Aug 27 03:40:42 user nova-compute[72990]:     </serial>
Aug 27 03:40:42 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:40:42 user nova-compute[72990]:     <video>
Aug 27 03:40:42 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:40:42 user nova-compute[72990]:     </video>
Aug 27 03:40:42 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:40:42 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:40:42 user nova-compute[72990]:     </rng>
Aug 27 03:40:42 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:40:42 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:40:42 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:40:42 user nova-compute[72990]:     </memballoon>
Aug 27 03:40:42 user nova-compute[72990]:   </devices>
Aug 27 03:40:42 user nova-compute[72990]: </domain>
Aug 27 03:40:42 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1426790154',display_name='tempest-ServerStableDeviceRescueTest-server-1426790154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1426790154',id=4,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuie8I1zmPTJR4MWFJd4uL9H7Y7zaw0i0/HxDbhxujiX8dZTY7PejDyY5i59a4QWzNZOOaKk6B+aPRfLvRmlc5NyO+hiXVGcLw0acVKee1aqH5Y4VgHEQo51OQ+4w65xg==',key_name='tempest-keypair-1407954263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37efbadb079847d6852574734e40de9a',ramdisk_id='',reservation_id='r-q7dxzftt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-181138782',owner_user_name='tempest-ServerStableDeviceRescueTest-181138782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5856ab8a362e440abcb62fdbc61f495b',uuid=7835f781-b543-4370-922b-3d2a76f9821b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Converting VIF {"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:62:6e,bridge_name='br-int',has_traffic_filtering=True,id=eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d,network=Network(58588dcd-f0f9-4efd-91b7-a15aeec22905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb08b4e3-74') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG os_vif [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:62:6e,bridge_name='br-int',has_traffic_filtering=True,id=eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d,network=Network(58588dcd-f0f9-4efd-91b7-a15aeec22905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb08b4e3-74') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb08b4e3-74, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb08b4e3-74, col_values=(('external_ids', {'iface-id': 'eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:62:6e', 'vm-uuid': '7835f781-b543-4370-922b-3d2a76f9821b'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:42 user nova-compute[72990]: INFO os_vif [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:62:6e,bridge_name='br-int',has_traffic_filtering=True,id=eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d,network=Network(58588dcd-f0f9-4efd-91b7-a15aeec22905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb08b4e3-74')
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:40:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] No VIF found with MAC fa:16:3e:1c:62:6e, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:40:43 user nova-compute[72990]: INFO nova.compute.manager [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Took 16.59 seconds to build instance.
Aug 27 03:40:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2ca52d9b-8fd5-45ed-a20e-8e9b7514a001 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.867s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.network.neutron [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updating instance_info_cache with network_info: [{"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Releasing lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Instance network_info: |[{"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-67fa8bba-c854-452d-ad3e-b73ccf00f7bb req-a6296713-3b03-4c7e-a99a-4b69493c7aed service nova] Acquired lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.network.neutron [req-67fa8bba-c854-452d-ad3e-b73ccf00f7bb req-a6296713-3b03-4c7e-a99a-4b69493c7aed service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Refreshing network info cache for port 7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Start _get_guest_xml network_info=[{"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:40:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-310419774',display_name='tempest-ServerActionsTestOtherA-server-310419774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-310419774',id=5,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx4YMOpiFApd+UuDRSLGi+Pmb0zohcJr1O+wFKm9ZeByZUcToOSr5LVAydvhFQAlBpKXomrxo0iOLbfaHvfjryxwDtlu2Xqz9AegDptkwou3u7ClkNhexzzpMlOVgjY6Q==',key_name='tempest-keypair-749840506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-u5ttx2jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=bcd09a59-c950-4143-bfc8-9a89705cca8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:8a:c0,bridge_name='br-int',has_traffic_filtering=True,id=7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a0d97c3-c4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.objects.instance [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lazy-loading 'pci_devices' on Instance uuid bcd09a59-c950-4143-bfc8-9a89705cca8c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:40:43 user nova-compute[72990]:   <uuid>bcd09a59-c950-4143-bfc8-9a89705cca8c</uuid>
Aug 27 03:40:43 user nova-compute[72990]:   <name>instance-00000005</name>
Aug 27 03:40:43 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:40:43 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:40:43 user nova-compute[72990]:   <metadata>
Aug 27 03:40:43 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:40:43 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:40:43 user nova-compute[72990]:       <nova:name>tempest-ServerActionsTestOtherA-server-310419774</nova:name>
Aug 27 03:40:43 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:40:43</nova:creationTime>
Aug 27 03:40:43 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:40:43 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:40:43 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:40:43 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:40:43 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:40:43 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:40:43 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:40:43 user nova-compute[72990]:       <nova:owner>
Aug 27 03:40:43 user nova-compute[72990]:         <nova:user uuid="cb95e31732904174a8ebddf48c6426ed">tempest-ServerActionsTestOtherA-938526966-project-member</nova:user>
Aug 27 03:40:43 user nova-compute[72990]:         <nova:project uuid="2282ed15ca724f029c368c8a5ce0f268">tempest-ServerActionsTestOtherA-938526966</nova:project>
Aug 27 03:40:43 user nova-compute[72990]:       </nova:owner>
Aug 27 03:40:43 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:40:43 user nova-compute[72990]:       <nova:ports>
Aug 27 03:40:43 user nova-compute[72990]:         <nova:port uuid="7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813">
Aug 27 03:40:43 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 03:40:43 user nova-compute[72990]:         </nova:port>
Aug 27 03:40:43 user nova-compute[72990]:       </nova:ports>
Aug 27 03:40:43 user nova-compute[72990]:     </nova:instance>
Aug 27 03:40:43 user nova-compute[72990]:   </metadata>
Aug 27 03:40:43 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:40:43 user nova-compute[72990]:     <system>
Aug 27 03:40:43 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:40:43 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:40:43 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:40:43 user nova-compute[72990]:       <entry name="serial">bcd09a59-c950-4143-bfc8-9a89705cca8c</entry>
Aug 27 03:40:43 user nova-compute[72990]:       <entry name="uuid">bcd09a59-c950-4143-bfc8-9a89705cca8c</entry>
Aug 27 03:40:43 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:40:43 user nova-compute[72990]:     </system>
Aug 27 03:40:43 user nova-compute[72990]:   </sysinfo>
Aug 27 03:40:43 user nova-compute[72990]:   <os>
Aug 27 03:40:43 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:40:43 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:40:43 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:40:43 user nova-compute[72990]:   </os>
Aug 27 03:40:43 user nova-compute[72990]:   <features>
Aug 27 03:40:43 user nova-compute[72990]:     <acpi/>
Aug 27 03:40:43 user nova-compute[72990]:     <apic/>
Aug 27 03:40:43 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:40:43 user nova-compute[72990]:   </features>
Aug 27 03:40:43 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:40:43 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:40:43 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:40:43 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:40:43 user nova-compute[72990]:   </clock>
Aug 27 03:40:43 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:40:43 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:40:43 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:40:43 user nova-compute[72990]:   </cpu>
Aug 27 03:40:43 user nova-compute[72990]:   <devices>
Aug 27 03:40:43 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:40:43 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:40:43 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk"/>
Aug 27 03:40:43 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:40:43 user nova-compute[72990]:     </disk>
Aug 27 03:40:43 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:40:43 user nova-compute[72990]:       <mac address="fa:16:3e:57:8a:c0"/>
Aug 27 03:40:43 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:40:43 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:40:43 user nova-compute[72990]:       <target dev="tap7a0d97c3-c4"/>
Aug 27 03:40:43 user nova-compute[72990]:     </interface>
Aug 27 03:40:43 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:40:43 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/console.log" append="off"/>
Aug 27 03:40:43 user nova-compute[72990]:     </serial>
Aug 27 03:40:43 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:40:43 user nova-compute[72990]:     <video>
Aug 27 03:40:43 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:40:43 user nova-compute[72990]:     </video>
Aug 27 03:40:43 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:40:43 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:40:43 user nova-compute[72990]:     </rng>
Aug 27 03:40:43 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:40:43 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:40:43 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:40:43 user nova-compute[72990]:     </memballoon>
Aug 27 03:40:43 user nova-compute[72990]:   </devices>
Aug 27 03:40:43 user nova-compute[72990]: </domain>
Aug 27 03:40:43 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-310419774',display_name='tempest-ServerActionsTestOtherA-server-310419774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-310419774',id=5,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx4YMOpiFApd+UuDRSLGi+Pmb0zohcJr1O+wFKm9ZeByZUcToOSr5LVAydvhFQAlBpKXomrxo0iOLbfaHvfjryxwDtlu2Xqz9AegDptkwou3u7ClkNhexzzpMlOVgjY6Q==',key_name='tempest-keypair-749840506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-u5ttx2jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=bcd09a59-c950-4143-bfc8-9a89705cca8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:8a:c0,bridge_name='br-int',has_traffic_filtering=True,id=7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a0d97c3-c4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG os_vif [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:8a:c0,bridge_name='br-int',has_traffic_filtering=True,id=7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a0d97c3-c4') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a0d97c3-c4, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a0d97c3-c4, col_values=(('external_ids', {'iface-id': '7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:8a:c0', 'vm-uuid': 'bcd09a59-c950-4143-bfc8-9a89705cca8c'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:43 user nova-compute[72990]: INFO os_vif [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:8a:c0,bridge_name='br-int',has_traffic_filtering=True,id=7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a0d97c3-c4')
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No VIF found with MAC fa:16:3e:57:8a:c0, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-63d8529d-8c69-4ae4-a50c-377f3c6b781e req-7831e89c-ec25-41f4-8878-1d7043356363 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63d8529d-8c69-4ae4-a50c-377f3c6b781e req-7831e89c-ec25-41f4-8878-1d7043356363 service nova] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63d8529d-8c69-4ae4-a50c-377f3c6b781e req-7831e89c-ec25-41f4-8878-1d7043356363 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63d8529d-8c69-4ae4-a50c-377f3c6b781e req-7831e89c-ec25-41f4-8878-1d7043356363 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-63d8529d-8c69-4ae4-a50c-377f3c6b781e req-7831e89c-ec25-41f4-8878-1d7043356363 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] No waiting events found dispatching network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:40:43 user nova-compute[72990]: WARNING nova.compute.manager [req-63d8529d-8c69-4ae4-a50c-377f3c6b781e req-7831e89c-ec25-41f4-8878-1d7043356363 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received unexpected event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 for instance with vm_state active and task_state None.
Aug 27 03:40:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG nova.network.neutron [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Successfully updated port: 11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "refresh_cache-970ca110-30d7-4e41-92d3-aa4e0bda4482" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquired lock "refresh_cache-970ca110-30d7-4e41-92d3-aa4e0bda4482" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG nova.network.neutron [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-890ca22f-287a-4c98-a33f-ba11a3643f52 req-ed1ab46f-579f-41a8-a494-8913e1eca573 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Received event network-changed-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-890ca22f-287a-4c98-a33f-ba11a3643f52 req-ed1ab46f-579f-41a8-a494-8913e1eca573 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Refreshing instance network info cache due to event network-changed-11a6b8fd-99ad-43d8-9daa-4594047d1ee8. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-890ca22f-287a-4c98-a33f-ba11a3643f52 req-ed1ab46f-579f-41a8-a494-8913e1eca573 service nova] Acquiring lock "refresh_cache-970ca110-30d7-4e41-92d3-aa4e0bda4482" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG nova.network.neutron [req-aba3a0f8-e378-4147-a815-dabf635cdd86 req-94b8d2cb-0eb2-432c-b074-c0622b03e0d2 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updated VIF entry in instance network info cache for port eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG nova.network.neutron [req-aba3a0f8-e378-4147-a815-dabf635cdd86 req-94b8d2cb-0eb2-432c-b074-c0622b03e0d2 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aba3a0f8-e378-4147-a815-dabf635cdd86 req-94b8d2cb-0eb2-432c-b074-c0622b03e0d2 service nova] Releasing lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:40:44 user nova-compute[72990]: DEBUG nova.network.neutron [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:40:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-67fa8bba-c854-452d-ad3e-b73ccf00f7bb req-a6296713-3b03-4c7e-a99a-4b69493c7aed service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updated VIF entry in instance network info cache for port 7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:40:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-67fa8bba-c854-452d-ad3e-b73ccf00f7bb req-a6296713-3b03-4c7e-a99a-4b69493c7aed service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updating instance_info_cache with network_info: [{"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:40:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-67fa8bba-c854-452d-ad3e-b73ccf00f7bb req-a6296713-3b03-4c7e-a99a-4b69493c7aed service nova] Releasing lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-fb99e659-b195-403c-b5c3-d464f69041c5 req-7d655b00-6d1f-4108-80c5-530fdfac1150 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fb99e659-b195-403c-b5c3-d464f69041c5 req-7d655b00-6d1f-4108-80c5-530fdfac1150 service nova] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fb99e659-b195-403c-b5c3-d464f69041c5 req-7d655b00-6d1f-4108-80c5-530fdfac1150 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fb99e659-b195-403c-b5c3-d464f69041c5 req-7d655b00-6d1f-4108-80c5-530fdfac1150 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-fb99e659-b195-403c-b5c3-d464f69041c5 req-7d655b00-6d1f-4108-80c5-530fdfac1150 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] No waiting events found dispatching network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:40:46 user nova-compute[72990]: WARNING nova.compute.manager [req-fb99e659-b195-403c-b5c3-d464f69041c5 req-7d655b00-6d1f-4108-80c5-530fdfac1150 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received unexpected event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 for instance with vm_state active and task_state None.
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.network.neutron [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Updating instance_info_cache with network_info: [{"id": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "address": "fa:16:3e:2f:ee:bb", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6b8fd-99", "ovs_interfaceid": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Releasing lock "refresh_cache-970ca110-30d7-4e41-92d3-aa4e0bda4482" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Instance network_info: |[{"id": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "address": "fa:16:3e:2f:ee:bb", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6b8fd-99", "ovs_interfaceid": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-890ca22f-287a-4c98-a33f-ba11a3643f52 req-ed1ab46f-579f-41a8-a494-8913e1eca573 service nova] Acquired lock "refresh_cache-970ca110-30d7-4e41-92d3-aa4e0bda4482" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.network.neutron [req-890ca22f-287a-4c98-a33f-ba11a3643f52 req-ed1ab46f-579f-41a8-a494-8913e1eca573 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Refreshing network info cache for port 11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Start _get_guest_xml network_info=[{"id": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "address": "fa:16:3e:2f:ee:bb", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6b8fd-99", "ovs_interfaceid": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:40:46 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:46 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-141058830',display_name='tempest-AttachVolumeNegativeTest-server-141058830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-141058830',id=6,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWORsaUu8hyR5t7tsTpUJcT9qwLvuCugt4ZtUfdJHrt2j+YFS1ySrkgr8nPSviJ6GzMZ9yMLnC3txJGfFhDiPCM4BKcalbJ3vNSbuhNjhtJpp8ltdQ0HDxzLofc7jqSAQ==',key_name='tempest-keypair-1480652458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d007a65dbbce40729d2d7a25561a4f91',ramdisk_id='',reservation_id='r-euaan0ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-945598863',owner_user_name='tempest-AttachVolumeNegativeTest-945598863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7d2fc4d4204ad38d0d11376de45bd6',uuid=970ca110-30d7-4e41-92d3-aa4e0bda4482,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "address": "fa:16:3e:2f:ee:bb", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6b8fd-99", "ovs_interfaceid": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converting VIF {"id": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "address": "fa:16:3e:2f:ee:bb", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6b8fd-99", "ovs_interfaceid": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:ee:bb,bridge_name='br-int',has_traffic_filtering=True,id=11a6b8fd-99ad-43d8-9daa-4594047d1ee8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6b8fd-99') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.objects.instance [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'pci_devices' on Instance uuid 970ca110-30d7-4e41-92d3-aa4e0bda4482 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:40:46 user nova-compute[72990]:   <uuid>970ca110-30d7-4e41-92d3-aa4e0bda4482</uuid>
Aug 27 03:40:46 user nova-compute[72990]:   <name>instance-00000006</name>
Aug 27 03:40:46 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:40:46 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:40:46 user nova-compute[72990]:   <metadata>
Aug 27 03:40:46 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:40:46 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:40:46 user nova-compute[72990]:       <nova:name>tempest-AttachVolumeNegativeTest-server-141058830</nova:name>
Aug 27 03:40:46 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:40:46</nova:creationTime>
Aug 27 03:40:46 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:40:46 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:40:46 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:40:46 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:40:46 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:40:46 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:40:46 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:40:46 user nova-compute[72990]:       <nova:owner>
Aug 27 03:40:46 user nova-compute[72990]:         <nova:user uuid="4e7d2fc4d4204ad38d0d11376de45bd6">tempest-AttachVolumeNegativeTest-945598863-project-member</nova:user>
Aug 27 03:40:46 user nova-compute[72990]:         <nova:project uuid="d007a65dbbce40729d2d7a25561a4f91">tempest-AttachVolumeNegativeTest-945598863</nova:project>
Aug 27 03:40:46 user nova-compute[72990]:       </nova:owner>
Aug 27 03:40:46 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:40:46 user nova-compute[72990]:       <nova:ports>
Aug 27 03:40:46 user nova-compute[72990]:         <nova:port uuid="11a6b8fd-99ad-43d8-9daa-4594047d1ee8">
Aug 27 03:40:46 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 03:40:46 user nova-compute[72990]:         </nova:port>
Aug 27 03:40:46 user nova-compute[72990]:       </nova:ports>
Aug 27 03:40:46 user nova-compute[72990]:     </nova:instance>
Aug 27 03:40:46 user nova-compute[72990]:   </metadata>
Aug 27 03:40:46 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:40:46 user nova-compute[72990]:     <system>
Aug 27 03:40:46 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:40:46 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:40:46 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:40:46 user nova-compute[72990]:       <entry name="serial">970ca110-30d7-4e41-92d3-aa4e0bda4482</entry>
Aug 27 03:40:46 user nova-compute[72990]:       <entry name="uuid">970ca110-30d7-4e41-92d3-aa4e0bda4482</entry>
Aug 27 03:40:46 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:40:46 user nova-compute[72990]:     </system>
Aug 27 03:40:46 user nova-compute[72990]:   </sysinfo>
Aug 27 03:40:46 user nova-compute[72990]:   <os>
Aug 27 03:40:46 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:40:46 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:40:46 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:40:46 user nova-compute[72990]:   </os>
Aug 27 03:40:46 user nova-compute[72990]:   <features>
Aug 27 03:40:46 user nova-compute[72990]:     <acpi/>
Aug 27 03:40:46 user nova-compute[72990]:     <apic/>
Aug 27 03:40:46 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:40:46 user nova-compute[72990]:   </features>
Aug 27 03:40:46 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:40:46 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:40:46 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:40:46 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:40:46 user nova-compute[72990]:   </clock>
Aug 27 03:40:46 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:40:46 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:40:46 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:40:46 user nova-compute[72990]:   </cpu>
Aug 27 03:40:46 user nova-compute[72990]:   <devices>
Aug 27 03:40:46 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:40:46 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:40:46 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk"/>
Aug 27 03:40:46 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:40:46 user nova-compute[72990]:     </disk>
Aug 27 03:40:46 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:40:46 user nova-compute[72990]:       <mac address="fa:16:3e:2f:ee:bb"/>
Aug 27 03:40:46 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:40:46 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:40:46 user nova-compute[72990]:       <target dev="tap11a6b8fd-99"/>
Aug 27 03:40:46 user nova-compute[72990]:     </interface>
Aug 27 03:40:46 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:40:46 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/console.log" append="off"/>
Aug 27 03:40:46 user nova-compute[72990]:     </serial>
Aug 27 03:40:46 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:40:46 user nova-compute[72990]:     <video>
Aug 27 03:40:46 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:40:46 user nova-compute[72990]:     </video>
Aug 27 03:40:46 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:40:46 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:40:46 user nova-compute[72990]:     </rng>
Aug 27 03:40:46 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:40:46 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:40:46 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:40:46 user nova-compute[72990]:     </memballoon>
Aug 27 03:40:46 user nova-compute[72990]:   </devices>
Aug 27 03:40:46 user nova-compute[72990]: </domain>
Aug 27 03:40:46 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-141058830',display_name='tempest-AttachVolumeNegativeTest-server-141058830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-141058830',id=6,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWORsaUu8hyR5t7tsTpUJcT9qwLvuCugt4ZtUfdJHrt2j+YFS1ySrkgr8nPSviJ6GzMZ9yMLnC3txJGfFhDiPCM4BKcalbJ3vNSbuhNjhtJpp8ltdQ0HDxzLofc7jqSAQ==',key_name='tempest-keypair-1480652458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d007a65dbbce40729d2d7a25561a4f91',ramdisk_id='',reservation_id='r-euaan0ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-945598863',owner_user_name='tempest-AttachVolumeNegativeTest-945598863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7d2fc4d4204ad38d0d11376de45bd6',uuid=970ca110-30d7-4e41-92d3-aa4e0bda4482,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "address": "fa:16:3e:2f:ee:bb", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6b8fd-99", "ovs_interfaceid": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converting VIF {"id": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "address": "fa:16:3e:2f:ee:bb", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6b8fd-99", "ovs_interfaceid": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:ee:bb,bridge_name='br-int',has_traffic_filtering=True,id=11a6b8fd-99ad-43d8-9daa-4594047d1ee8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6b8fd-99') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG os_vif [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:ee:bb,bridge_name='br-int',has_traffic_filtering=True,id=11a6b8fd-99ad-43d8-9daa-4594047d1ee8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6b8fd-99') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:40:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11a6b8fd-99, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11a6b8fd-99, col_values=(('external_ids', {'iface-id': '11a6b8fd-99ad-43d8-9daa-4594047d1ee8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:ee:bb', 'vm-uuid': '970ca110-30d7-4e41-92d3-aa4e0bda4482'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:40:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:40:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:47 user nova-compute[72990]: INFO os_vif [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:ee:bb,bridge_name='br-int',has_traffic_filtering=True,id=11a6b8fd-99ad-43d8-9daa-4594047d1ee8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6b8fd-99')
Aug 27 03:40:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:40:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No VIF found with MAC fa:16:3e:2f:ee:bb, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:40:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:48 user nova-compute[72990]: DEBUG nova.network.neutron [req-890ca22f-287a-4c98-a33f-ba11a3643f52 req-ed1ab46f-579f-41a8-a494-8913e1eca573 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Updated VIF entry in instance network info cache for port 11a6b8fd-99ad-43d8-9daa-4594047d1ee8. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:40:48 user nova-compute[72990]: DEBUG nova.network.neutron [req-890ca22f-287a-4c98-a33f-ba11a3643f52 req-ed1ab46f-579f-41a8-a494-8913e1eca573 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Updating instance_info_cache with network_info: [{"id": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "address": "fa:16:3e:2f:ee:bb", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6b8fd-99", "ovs_interfaceid": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:40:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-890ca22f-287a-4c98-a33f-ba11a3643f52 req-ed1ab46f-579f-41a8-a494-8913e1eca573 service nova] Releasing lock "refresh_cache-970ca110-30d7-4e41-92d3-aa4e0bda4482" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:40:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107651.3068326, 7835f781-b543-4370-922b-3d2a76f9821b => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:40:51 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] VM Resumed (Lifecycle Event)
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:40:51 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Instance spawned successfully.
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:51 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107651.308402, 7835f781-b543-4370-922b-3d2a76f9821b => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:40:51 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] VM Started (Lifecycle Event)
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:40:51 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:40:51 user nova-compute[72990]: INFO nova.compute.manager [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Took 15.65 seconds to spawn the instance on the hypervisor.
Aug 27 03:40:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:51 user nova-compute[72990]: INFO nova.compute.manager [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Took 16.72 seconds to build instance.
Aug 27 03:40:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2def6669-7f11-4558-8e98-cb512baa9506 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "7835f781-b543-4370-922b-3d2a76f9821b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.882s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107652.2415721, bcd09a59-c950-4143-bfc8-9a89705cca8c => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:40:52 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] VM Resumed (Lifecycle Event)
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:40:52 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Instance spawned successfully.
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:40:52 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107652.2426589, bcd09a59-c950-4143-bfc8-9a89705cca8c => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:40:52 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] VM Started (Lifecycle Event)
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:40:52 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107652.5900583, 970ca110-30d7-4e41-92d3-aa4e0bda4482 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:40:52 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] VM Resumed (Lifecycle Event)
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:52 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Instance spawned successfully.
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:40:52 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107652.5952618, 970ca110-30d7-4e41-92d3-aa4e0bda4482 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:40:52 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] VM Started (Lifecycle Event)
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:40:52 user nova-compute[72990]: INFO nova.compute.manager [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Took 15.20 seconds to spawn the instance on the hypervisor.
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:52 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:40:53 user nova-compute[72990]: INFO nova.compute.manager [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Took 16.24 seconds to build instance.
Aug 27 03:40:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30770ded-69af-4879-82cc-89bd5055e223 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.400s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:53 user nova-compute[72990]: INFO nova.compute.manager [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Took 13.72 seconds to spawn the instance on the hypervisor.
Aug 27 03:40:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:40:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-998d4e18-3ef3-4ccf-990e-a5c5548c1b3d req-73811fae-ca1b-45e6-a15e-534e877ea84f service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received event network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-998d4e18-3ef3-4ccf-990e-a5c5548c1b3d req-73811fae-ca1b-45e6-a15e-534e877ea84f service nova] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-998d4e18-3ef3-4ccf-990e-a5c5548c1b3d req-73811fae-ca1b-45e6-a15e-534e877ea84f service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-998d4e18-3ef3-4ccf-990e-a5c5548c1b3d req-73811fae-ca1b-45e6-a15e-534e877ea84f service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-998d4e18-3ef3-4ccf-990e-a5c5548c1b3d req-73811fae-ca1b-45e6-a15e-534e877ea84f service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] No waiting events found dispatching network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:40:53 user nova-compute[72990]: WARNING nova.compute.manager [req-998d4e18-3ef3-4ccf-990e-a5c5548c1b3d req-73811fae-ca1b-45e6-a15e-534e877ea84f service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received unexpected event network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c for instance with vm_state active and task_state None.
Aug 27 03:40:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:53 user nova-compute[72990]: INFO nova.compute.manager [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Took 14.94 seconds to build instance.
Aug 27 03:40:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0008ce73-6f17-4442-a1d9-d6704a9d1c93 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.272s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received event network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] No waiting events found dispatching network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:40:55 user nova-compute[72990]: WARNING nova.compute.manager [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received unexpected event network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c for instance with vm_state active and task_state None.
Aug 27 03:40:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Received event network-vif-plugged-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] Acquiring lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] No waiting events found dispatching network-vif-plugged-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:40:55 user nova-compute[72990]: WARNING nova.compute.manager [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Received unexpected event network-vif-plugged-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 for instance with vm_state active and task_state None.
Aug 27 03:40:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Received event network-vif-plugged-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] Acquiring lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] No waiting events found dispatching network-vif-plugged-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:40:55 user nova-compute[72990]: WARNING nova.compute.manager [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Received unexpected event network-vif-plugged-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 for instance with vm_state active and task_state None.
Aug 27 03:40:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Received event network-vif-plugged-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] Acquiring lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] No waiting events found dispatching network-vif-plugged-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:40:55 user nova-compute[72990]: WARNING nova.compute.manager [req-72a74c52-0863-4c39-80e9-d7a4d0260e56 req-9ad814f2-e0d6-49e8-aa1c-4804fed1b13f service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Received unexpected event network-vif-plugged-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 for instance with vm_state active and task_state None.
Aug 27 03:40:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:40:55 user nova-compute[72990]: INFO nova.compute.claims [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Claim successful on node user
Aug 27 03:40:55 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.769s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG nova.network.neutron [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:40:56 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 27 03:40:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG nova.policy [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0b94da4a8ca4450ab0c5989e5dfd5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206c0eeae224e4a985ee0d49c42a051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:40:56 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Creating image(s)
Aug 27 03:40:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "/opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "/opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "34a22971449cdeda2c57bfed1dd687d30c671052" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "34a22971449cdeda2c57bfed1dd687d30c671052" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052.part --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:40:57 user nova-compute[72990]: DEBUG nova.compute.manager [req-a4365de6-1063-436a-85ed-66eac122e0d3 req-d05c2af1-0c16-442e-9d1e-8f14502779a2 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Received event network-vif-plugged-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:40:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a4365de6-1063-436a-85ed-66eac122e0d3 req-d05c2af1-0c16-442e-9d1e-8f14502779a2 service nova] Acquiring lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a4365de6-1063-436a-85ed-66eac122e0d3 req-d05c2af1-0c16-442e-9d1e-8f14502779a2 service nova] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a4365de6-1063-436a-85ed-66eac122e0d3 req-d05c2af1-0c16-442e-9d1e-8f14502779a2 service nova] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:57 user nova-compute[72990]: DEBUG nova.compute.manager [req-a4365de6-1063-436a-85ed-66eac122e0d3 req-d05c2af1-0c16-442e-9d1e-8f14502779a2 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] No waiting events found dispatching network-vif-plugged-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:40:57 user nova-compute[72990]: WARNING nova.compute.manager [req-a4365de6-1063-436a-85ed-66eac122e0d3 req-d05c2af1-0c16-442e-9d1e-8f14502779a2 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Received unexpected event network-vif-plugged-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 for instance with vm_state active and task_state None.
Aug 27 03:40:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052.part --force-share --output=json" returned: 0 in 0.358s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:57 user nova-compute[72990]: DEBUG nova.virt.images [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] 85c450f2-38e4-4c4f-b26b-5ea730022b5c was qcow2, converting to raw {{(pid=72990) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 03:40:57 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:40:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052.part /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052.converted {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052.part /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052.converted" returned: 0 in 0.287s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052.converted --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:58 user nova-compute[72990]: DEBUG nova.network.neutron [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Successfully created port: 0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:40:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052.converted --force-share --output=json" returned: 0 in 0.263s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "34a22971449cdeda2c57bfed1dd687d30c671052" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.659s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052 --force-share --output=json" returned: 0 in 0.235s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "34a22971449cdeda2c57bfed1dd687d30c671052" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "34a22971449cdeda2c57bfed1dd687d30c671052" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052 --force-share --output=json" returned: 0 in 0.328s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052,backing_fmt=raw /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052,backing_fmt=raw /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk 1073741824" returned: 0 in 0.083s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "34a22971449cdeda2c57bfed1dd687d30c671052" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.430s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052 --force-share --output=json" returned: 0 in 0.269s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Cannot resize image /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Ensure instance console log exists: /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:40:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG nova.network.neutron [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Successfully updated port: 0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "refresh_cache-3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquired lock "refresh_cache-3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG nova.network.neutron [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-82484c5f-5d9d-4e6b-9bc1-6b807c164da2 req-a69fb1aa-6404-4c60-bd9f-645007dac571 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Received event network-changed-0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-82484c5f-5d9d-4e6b-9bc1-6b807c164da2 req-a69fb1aa-6404-4c60-bd9f-645007dac571 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Refreshing instance network info cache due to event network-changed-0ac002a5-64fb-40b4-8da9-22b54f104689. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-82484c5f-5d9d-4e6b-9bc1-6b807c164da2 req-a69fb1aa-6404-4c60-bd9f-645007dac571 service nova] Acquiring lock "refresh_cache-3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:00 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:41:00 user nova-compute[72990]: INFO nova.compute.claims [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Claim successful on node user
Aug 27 03:41:00 user nova-compute[72990]: DEBUG nova.network.neutron [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.network.neutron [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Updating instance_info_cache with network_info: [{"id": "0ac002a5-64fb-40b4-8da9-22b54f104689", "address": "fa:16:3e:08:63:16", "network": {"id": "198f33b4-c259-4dea-9f48-11e7d97c8cd4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1964452619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e206c0eeae224e4a985ee0d49c42a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac002a5-64", "ovs_interfaceid": "0ac002a5-64fb-40b4-8da9-22b54f104689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Releasing lock "refresh_cache-3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Instance network_info: |[{"id": "0ac002a5-64fb-40b4-8da9-22b54f104689", "address": "fa:16:3e:08:63:16", "network": {"id": "198f33b4-c259-4dea-9f48-11e7d97c8cd4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1964452619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e206c0eeae224e4a985ee0d49c42a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac002a5-64", "ovs_interfaceid": "0ac002a5-64fb-40b4-8da9-22b54f104689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-82484c5f-5d9d-4e6b-9bc1-6b807c164da2 req-a69fb1aa-6404-4c60-bd9f-645007dac571 service nova] Acquired lock "refresh_cache-3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.network.neutron [req-82484c5f-5d9d-4e6b-9bc1-6b807c164da2 req-a69fb1aa-6404-4c60-bd9f-645007dac571 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Refreshing network info cache for port 0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Start _get_guest_xml network_info=[{"id": "0ac002a5-64fb-40b4-8da9-22b54f104689", "address": "fa:16:3e:08:63:16", "network": {"id": "198f33b4-c259-4dea-9f48-11e7d97c8cd4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1964452619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e206c0eeae224e4a985ee0d49c42a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac002a5-64", "ovs_interfaceid": "0ac002a5-64fb-40b4-8da9-22b54f104689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:40:41Z,direct_url=<?>,disk_format='qcow2',id=85c450f2-38e4-4c4f-b26b-5ea730022b5c,min_disk=0,min_ram=0,name='',owner='3bbbcc00dc054978bd7ea7cd52aebcd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:40:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'disk_bus': 'scsi', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/sda', 'boot_index': 0, 'size': 0, 'image_id': '85c450f2-38e4-4c4f-b26b-5ea730022b5c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:41:01 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:41:01 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:40:41Z,direct_url=<?>,disk_format='qcow2',id=85c450f2-38e4-4c4f-b26b-5ea730022b5c,min_disk=0,min_ram=0,name='',owner='3bbbcc00dc054978bd7ea7cd52aebcd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:40:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1085982954',display_name='tempest-AttachSCSIVolumeTestJSON-server-1085982954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1085982954',id=7,image_ref='85c450f2-38e4-4c4f-b26b-5ea730022b5c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5UZrdz8DkfGMyKoWtbnGqZSmpO1ZqhLMhzkOc2xvcCLDDksg5gGjhzu/g2CFaYiV4bE/puczfBtx/uaUROhz7fGQlEHE5mSt86Hnlnu/6EX0KM1EVthjV6+NcDHWDxGw==',key_name='tempest-keypair-1707821719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e206c0eeae224e4a985ee0d49c42a051',ramdisk_id='',reservation_id='r-hq3h824e',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='85c450f2-38e4-4c4f-b26b-5ea730022b5c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1947338428',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1947338428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0b94da4a8ca4450ab0c5989e5dfd5e3',uuid=3cb2360e-e8b2-48c0-96d4-cde86cf1a28e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac002a5-64fb-40b4-8da9-22b54f104689", "address": "fa:16:3e:08:63:16", "network": {"id": "198f33b4-c259-4dea-9f48-11e7d97c8cd4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1964452619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e206c0eeae224e4a985ee0d49c42a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac002a5-64", "ovs_interfaceid": "0ac002a5-64fb-40b4-8da9-22b54f104689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Converting VIF {"id": "0ac002a5-64fb-40b4-8da9-22b54f104689", "address": "fa:16:3e:08:63:16", "network": {"id": "198f33b4-c259-4dea-9f48-11e7d97c8cd4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1964452619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e206c0eeae224e4a985ee0d49c42a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac002a5-64", "ovs_interfaceid": "0ac002a5-64fb-40b4-8da9-22b54f104689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:63:16,bridge_name='br-int',has_traffic_filtering=True,id=0ac002a5-64fb-40b4-8da9-22b54f104689,network=Network(198f33b4-c259-4dea-9f48-11e7d97c8cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac002a5-64') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.objects.instance [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:41:01 user nova-compute[72990]:   <uuid>3cb2360e-e8b2-48c0-96d4-cde86cf1a28e</uuid>
Aug 27 03:41:01 user nova-compute[72990]:   <name>instance-00000007</name>
Aug 27 03:41:01 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:41:01 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:41:01 user nova-compute[72990]:   <metadata>
Aug 27 03:41:01 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:41:01 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:41:01 user nova-compute[72990]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1085982954</nova:name>
Aug 27 03:41:01 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:41:01</nova:creationTime>
Aug 27 03:41:01 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:41:01 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:41:01 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:41:01 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:41:01 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:41:01 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:41:01 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:41:01 user nova-compute[72990]:       <nova:owner>
Aug 27 03:41:01 user nova-compute[72990]:         <nova:user uuid="e0b94da4a8ca4450ab0c5989e5dfd5e3">tempest-AttachSCSIVolumeTestJSON-1947338428-project-member</nova:user>
Aug 27 03:41:01 user nova-compute[72990]:         <nova:project uuid="e206c0eeae224e4a985ee0d49c42a051">tempest-AttachSCSIVolumeTestJSON-1947338428</nova:project>
Aug 27 03:41:01 user nova-compute[72990]:       </nova:owner>
Aug 27 03:41:01 user nova-compute[72990]:       <nova:root type="image" uuid="85c450f2-38e4-4c4f-b26b-5ea730022b5c"/>
Aug 27 03:41:01 user nova-compute[72990]:       <nova:ports>
Aug 27 03:41:01 user nova-compute[72990]:         <nova:port uuid="0ac002a5-64fb-40b4-8da9-22b54f104689">
Aug 27 03:41:01 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 03:41:01 user nova-compute[72990]:         </nova:port>
Aug 27 03:41:01 user nova-compute[72990]:       </nova:ports>
Aug 27 03:41:01 user nova-compute[72990]:     </nova:instance>
Aug 27 03:41:01 user nova-compute[72990]:   </metadata>
Aug 27 03:41:01 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:41:01 user nova-compute[72990]:     <system>
Aug 27 03:41:01 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:41:01 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:41:01 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:41:01 user nova-compute[72990]:       <entry name="serial">3cb2360e-e8b2-48c0-96d4-cde86cf1a28e</entry>
Aug 27 03:41:01 user nova-compute[72990]:       <entry name="uuid">3cb2360e-e8b2-48c0-96d4-cde86cf1a28e</entry>
Aug 27 03:41:01 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:41:01 user nova-compute[72990]:     </system>
Aug 27 03:41:01 user nova-compute[72990]:   </sysinfo>
Aug 27 03:41:01 user nova-compute[72990]:   <os>
Aug 27 03:41:01 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:41:01 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:41:01 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:41:01 user nova-compute[72990]:   </os>
Aug 27 03:41:01 user nova-compute[72990]:   <features>
Aug 27 03:41:01 user nova-compute[72990]:     <acpi/>
Aug 27 03:41:01 user nova-compute[72990]:     <apic/>
Aug 27 03:41:01 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:41:01 user nova-compute[72990]:   </features>
Aug 27 03:41:01 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:41:01 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:41:01 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:41:01 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:41:01 user nova-compute[72990]:   </clock>
Aug 27 03:41:01 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:41:01 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:41:01 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:41:01 user nova-compute[72990]:   </cpu>
Aug 27 03:41:01 user nova-compute[72990]:   <devices>
Aug 27 03:41:01 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:41:01 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:41:01 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk"/>
Aug 27 03:41:01 user nova-compute[72990]:       <target dev="sda" bus="scsi"/>
Aug 27 03:41:01 user nova-compute[72990]:       <address type="drive" controller="0" unit="0"/>
Aug 27 03:41:01 user nova-compute[72990]:     </disk>
Aug 27 03:41:01 user nova-compute[72990]:     <disk type="file" device="cdrom">
Aug 27 03:41:01 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 03:41:01 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk.config"/>
Aug 27 03:41:01 user nova-compute[72990]:       <target dev="sdb" bus="scsi"/>
Aug 27 03:41:01 user nova-compute[72990]:       <address type="drive" controller="0" unit="1"/>
Aug 27 03:41:01 user nova-compute[72990]:     </disk>
Aug 27 03:41:01 user nova-compute[72990]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 27 03:41:01 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:41:01 user nova-compute[72990]:       <mac address="fa:16:3e:08:63:16"/>
Aug 27 03:41:01 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:41:01 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:41:01 user nova-compute[72990]:       <target dev="tap0ac002a5-64"/>
Aug 27 03:41:01 user nova-compute[72990]:     </interface>
Aug 27 03:41:01 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:41:01 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/console.log" append="off"/>
Aug 27 03:41:01 user nova-compute[72990]:     </serial>
Aug 27 03:41:01 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:41:01 user nova-compute[72990]:     <video>
Aug 27 03:41:01 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:41:01 user nova-compute[72990]:     </video>
Aug 27 03:41:01 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:41:01 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:41:01 user nova-compute[72990]:     </rng>
Aug 27 03:41:01 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:41:01 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:41:01 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:41:01 user nova-compute[72990]:     </memballoon>
Aug 27 03:41:01 user nova-compute[72990]:   </devices>
Aug 27 03:41:01 user nova-compute[72990]: </domain>
Aug 27 03:41:01 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1085982954',display_name='tempest-AttachSCSIVolumeTestJSON-server-1085982954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1085982954',id=7,image_ref='85c450f2-38e4-4c4f-b26b-5ea730022b5c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5UZrdz8DkfGMyKoWtbnGqZSmpO1ZqhLMhzkOc2xvcCLDDksg5gGjhzu/g2CFaYiV4bE/puczfBtx/uaUROhz7fGQlEHE5mSt86Hnlnu/6EX0KM1EVthjV6+NcDHWDxGw==',key_name='tempest-keypair-1707821719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e206c0eeae224e4a985ee0d49c42a051',ramdisk_id='',reservation_id='r-hq3h824e',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='85c450f2-38e4-4c4f-b26b-5ea730022b5c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1947338428',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1947338428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0b94da4a8ca4450ab0c5989e5dfd5e3',uuid=3cb2360e-e8b2-48c0-96d4-cde86cf1a28e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac002a5-64fb-40b4-8da9-22b54f104689", "address": "fa:16:3e:08:63:16", "network": {"id": "198f33b4-c259-4dea-9f48-11e7d97c8cd4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1964452619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e206c0eeae224e4a985ee0d49c42a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac002a5-64", "ovs_interfaceid": "0ac002a5-64fb-40b4-8da9-22b54f104689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Converting VIF {"id": "0ac002a5-64fb-40b4-8da9-22b54f104689", "address": "fa:16:3e:08:63:16", "network": {"id": "198f33b4-c259-4dea-9f48-11e7d97c8cd4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1964452619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e206c0eeae224e4a985ee0d49c42a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac002a5-64", "ovs_interfaceid": "0ac002a5-64fb-40b4-8da9-22b54f104689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:63:16,bridge_name='br-int',has_traffic_filtering=True,id=0ac002a5-64fb-40b4-8da9-22b54f104689,network=Network(198f33b4-c259-4dea-9f48-11e7d97c8cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac002a5-64') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG os_vif [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:63:16,bridge_name='br-int',has_traffic_filtering=True,id=0ac002a5-64fb-40b4-8da9-22b54f104689,network=Network(198f33b4-c259-4dea-9f48-11e7d97c8cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac002a5-64') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ac002a5-64, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ac002a5-64, col_values=(('external_ids', {'iface-id': '0ac002a5-64fb-40b4-8da9-22b54f104689', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:63:16', 'vm-uuid': '3cb2360e-e8b2-48c0-96d4-cde86cf1a28e'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:01 user nova-compute[72990]: INFO os_vif [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:63:16,bridge_name='br-int',has_traffic_filtering=True,id=0ac002a5-64fb-40b4-8da9-22b54f104689,network=Network(198f33b4-c259-4dea-9f48-11e7d97c8cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac002a5-64')
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] No BDM found with device name sda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] No VIF found with MAC fa:16:3e:08:63:16, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:41:01 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Using config drive
Aug 27 03:41:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.141s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:41:01 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:41:01 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Creating image(s)
Aug 27 03:41:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "/opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "/opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG nova.policy [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70e76f4237f8491da1a1003787625936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8ee9d65a3449cc8793fe94beb962b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.302s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.296s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk 1073741824" returned: 0 in 0.074s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.383s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.268s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-9426f5a7-6b4d-41e0-82d5-7b98d7bf4f77 req-c232baab-a865-4516-be73-72f4666297b3 service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Received event network-vif-plugged-4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9426f5a7-6b4d-41e0-82d5-7b98d7bf4f77 req-c232baab-a865-4516-be73-72f4666297b3 service nova] Acquiring lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9426f5a7-6b4d-41e0-82d5-7b98d7bf4f77 req-c232baab-a865-4516-be73-72f4666297b3 service nova] Lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9426f5a7-6b4d-41e0-82d5-7b98d7bf4f77 req-c232baab-a865-4516-be73-72f4666297b3 service nova] Lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-9426f5a7-6b4d-41e0-82d5-7b98d7bf4f77 req-c232baab-a865-4516-be73-72f4666297b3 service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] No waiting events found dispatching network-vif-plugged-4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:41:02 user nova-compute[72990]: WARNING nova.compute.manager [req-9426f5a7-6b4d-41e0-82d5-7b98d7bf4f77 req-c232baab-a865-4516-be73-72f4666297b3 service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Received unexpected event network-vif-plugged-4f10397c-dcdf-4be9-8744-fe97b2046fab for instance with vm_state active and task_state None.
Aug 27 03:41:02 user nova-compute[72990]: DEBUG nova.network.neutron [req-82484c5f-5d9d-4e6b-9bc1-6b807c164da2 req-a69fb1aa-6404-4c60-bd9f-645007dac571 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Updated VIF entry in instance network info cache for port 0ac002a5-64fb-40b4-8da9-22b54f104689. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG nova.network.neutron [req-82484c5f-5d9d-4e6b-9bc1-6b807c164da2 req-a69fb1aa-6404-4c60-bd9f-645007dac571 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Updating instance_info_cache with network_info: [{"id": "0ac002a5-64fb-40b4-8da9-22b54f104689", "address": "fa:16:3e:08:63:16", "network": {"id": "198f33b4-c259-4dea-9f48-11e7d97c8cd4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1964452619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e206c0eeae224e4a985ee0d49c42a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac002a5-64", "ovs_interfaceid": "0ac002a5-64fb-40b4-8da9-22b54f104689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:41:02 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Creating config drive at /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk.config
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4g4syfd7 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-82484c5f-5d9d-4e6b-9bc1-6b807c164da2 req-a69fb1aa-6404-4c60-bd9f-645007dac571 service nova] Releasing lock "refresh_cache-3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:41:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4g4syfd7" returned: 0 in 0.066s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:03 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Cannot resize image /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:41:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:41:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Ensure instance console log exists: /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:41:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:03 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Successfully created port: 48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:41:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Received event network-vif-plugged-4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] Acquiring lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] Lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] Lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] No waiting events found dispatching network-vif-plugged-4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:41:04 user nova-compute[72990]: WARNING nova.compute.manager [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Received unexpected event network-vif-plugged-4f10397c-dcdf-4be9-8744-fe97b2046fab for instance with vm_state active and task_state None.
Aug 27 03:41:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] No waiting events found dispatching network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:41:04 user nova-compute[72990]: WARNING nova.compute.manager [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received unexpected event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d for instance with vm_state active and task_state None.
Aug 27 03:41:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] No waiting events found dispatching network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:41:04 user nova-compute[72990]: WARNING nova.compute.manager [req-e6b3197c-64d5-4e0c-b1d3-d97e80bdcfc4 req-ff195397-65ff-4c35-abcf-7db3d14ff044 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received unexpected event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d for instance with vm_state active and task_state None.
Aug 27 03:41:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-c379b696-bb22-4a5f-97cd-8414b330069d req-fbc77394-9263-4b3f-bcfe-c1ce38927961 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Received event network-vif-plugged-0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c379b696-bb22-4a5f-97cd-8414b330069d req-fbc77394-9263-4b3f-bcfe-c1ce38927961 service nova] Acquiring lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c379b696-bb22-4a5f-97cd-8414b330069d req-fbc77394-9263-4b3f-bcfe-c1ce38927961 service nova] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c379b696-bb22-4a5f-97cd-8414b330069d req-fbc77394-9263-4b3f-bcfe-c1ce38927961 service nova] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-c379b696-bb22-4a5f-97cd-8414b330069d req-fbc77394-9263-4b3f-bcfe-c1ce38927961 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] No waiting events found dispatching network-vif-plugged-0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:41:05 user nova-compute[72990]: WARNING nova.compute.manager [req-c379b696-bb22-4a5f-97cd-8414b330069d req-fbc77394-9263-4b3f-bcfe-c1ce38927961 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Received unexpected event network-vif-plugged-0ac002a5-64fb-40b4-8da9-22b54f104689 for instance with vm_state building and task_state spawning.
Aug 27 03:41:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:06 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Successfully updated port: 48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:41:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "refresh_cache-bc82cced-9f16-44bc-b9bc-622fa99b1be0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:41:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquired lock "refresh_cache-bc82cced-9f16-44bc-b9bc-622fa99b1be0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:41:06 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:41:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:06 user nova-compute[72990]: DEBUG nova.compute.manager [req-f73ba84d-5fbc-40d6-bd8c-ae5c167fd028 req-42248249-f969-4fd3-aa24-43209e6230fb service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-changed-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:06 user nova-compute[72990]: DEBUG nova.compute.manager [req-f73ba84d-5fbc-40d6-bd8c-ae5c167fd028 req-42248249-f969-4fd3-aa24-43209e6230fb service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Refreshing instance network info cache due to event network-changed-48bea006-1d46-416d-8ab6-99617cdbcb63. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:41:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f73ba84d-5fbc-40d6-bd8c-ae5c167fd028 req-42248249-f969-4fd3-aa24-43209e6230fb service nova] Acquiring lock "refresh_cache-bc82cced-9f16-44bc-b9bc-622fa99b1be0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:41:06 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:41:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Updating instance_info_cache with network_info: [{"id": "48bea006-1d46-416d-8ab6-99617cdbcb63", "address": "fa:16:3e:b7:4e:53", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bea006-1d", "ovs_interfaceid": "48bea006-1d46-416d-8ab6-99617cdbcb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Releasing lock "refresh_cache-bc82cced-9f16-44bc-b9bc-622fa99b1be0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Instance network_info: |[{"id": "48bea006-1d46-416d-8ab6-99617cdbcb63", "address": "fa:16:3e:b7:4e:53", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bea006-1d", "ovs_interfaceid": "48bea006-1d46-416d-8ab6-99617cdbcb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f73ba84d-5fbc-40d6-bd8c-ae5c167fd028 req-42248249-f969-4fd3-aa24-43209e6230fb service nova] Acquired lock "refresh_cache-bc82cced-9f16-44bc-b9bc-622fa99b1be0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.network.neutron [req-f73ba84d-5fbc-40d6-bd8c-ae5c167fd028 req-42248249-f969-4fd3-aa24-43209e6230fb service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Refreshing network info cache for port 48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Start _get_guest_xml network_info=[{"id": "48bea006-1d46-416d-8ab6-99617cdbcb63", "address": "fa:16:3e:b7:4e:53", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bea006-1d", "ovs_interfaceid": "48bea006-1d46-416d-8ab6-99617cdbcb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:41:07 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:41:07 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-224545468',display_name='tempest-VolumesAdminNegativeTest-server-224545468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-224545468',id=8,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrvMAWrGSE690SJX2UCJTWj4tFHLTkqnANgUuE1tSUDNQCinv6wyWDM47ESyj9c8qsCifoP2Rh7NNqP2Ujug6A7kim22xdnbYKWOqyYz2HtCUgzmsanWy20N9Ph25x7jw==',key_name='tempest-keypair-1596844096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c8ee9d65a3449cc8793fe94beb962b9',ramdisk_id='',reservation_id='r-on494m0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1331051968',owner_user_name='tempest-VolumesAdminNegativeTest-1331051968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:41:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70e76f4237f8491da1a1003787625936',uuid=bc82cced-9f16-44bc-b9bc-622fa99b1be0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48bea006-1d46-416d-8ab6-99617cdbcb63", "address": "fa:16:3e:b7:4e:53", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bea006-1d", "ovs_interfaceid": "48bea006-1d46-416d-8ab6-99617cdbcb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Converting VIF {"id": "48bea006-1d46-416d-8ab6-99617cdbcb63", "address": "fa:16:3e:b7:4e:53", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bea006-1d", "ovs_interfaceid": "48bea006-1d46-416d-8ab6-99617cdbcb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=48bea006-1d46-416d-8ab6-99617cdbcb63,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bea006-1d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.objects.instance [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lazy-loading 'pci_devices' on Instance uuid bc82cced-9f16-44bc-b9bc-622fa99b1be0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:41:07 user nova-compute[72990]:   <uuid>bc82cced-9f16-44bc-b9bc-622fa99b1be0</uuid>
Aug 27 03:41:07 user nova-compute[72990]:   <name>instance-00000008</name>
Aug 27 03:41:07 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:41:07 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:41:07 user nova-compute[72990]:   <metadata>
Aug 27 03:41:07 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:41:07 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:41:07 user nova-compute[72990]:       <nova:name>tempest-VolumesAdminNegativeTest-server-224545468</nova:name>
Aug 27 03:41:07 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:41:07</nova:creationTime>
Aug 27 03:41:07 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:41:07 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:41:07 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:41:07 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:41:07 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:41:07 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:41:07 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:41:07 user nova-compute[72990]:       <nova:owner>
Aug 27 03:41:07 user nova-compute[72990]:         <nova:user uuid="70e76f4237f8491da1a1003787625936">tempest-VolumesAdminNegativeTest-1331051968-project-member</nova:user>
Aug 27 03:41:07 user nova-compute[72990]:         <nova:project uuid="0c8ee9d65a3449cc8793fe94beb962b9">tempest-VolumesAdminNegativeTest-1331051968</nova:project>
Aug 27 03:41:07 user nova-compute[72990]:       </nova:owner>
Aug 27 03:41:07 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:41:07 user nova-compute[72990]:       <nova:ports>
Aug 27 03:41:07 user nova-compute[72990]:         <nova:port uuid="48bea006-1d46-416d-8ab6-99617cdbcb63">
Aug 27 03:41:07 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 03:41:07 user nova-compute[72990]:         </nova:port>
Aug 27 03:41:07 user nova-compute[72990]:       </nova:ports>
Aug 27 03:41:07 user nova-compute[72990]:     </nova:instance>
Aug 27 03:41:07 user nova-compute[72990]:   </metadata>
Aug 27 03:41:07 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:41:07 user nova-compute[72990]:     <system>
Aug 27 03:41:07 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:41:07 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:41:07 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:41:07 user nova-compute[72990]:       <entry name="serial">bc82cced-9f16-44bc-b9bc-622fa99b1be0</entry>
Aug 27 03:41:07 user nova-compute[72990]:       <entry name="uuid">bc82cced-9f16-44bc-b9bc-622fa99b1be0</entry>
Aug 27 03:41:07 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:41:07 user nova-compute[72990]:     </system>
Aug 27 03:41:07 user nova-compute[72990]:   </sysinfo>
Aug 27 03:41:07 user nova-compute[72990]:   <os>
Aug 27 03:41:07 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:41:07 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:41:07 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:41:07 user nova-compute[72990]:   </os>
Aug 27 03:41:07 user nova-compute[72990]:   <features>
Aug 27 03:41:07 user nova-compute[72990]:     <acpi/>
Aug 27 03:41:07 user nova-compute[72990]:     <apic/>
Aug 27 03:41:07 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:41:07 user nova-compute[72990]:   </features>
Aug 27 03:41:07 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:41:07 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:41:07 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:41:07 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:41:07 user nova-compute[72990]:   </clock>
Aug 27 03:41:07 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:41:07 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:41:07 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:41:07 user nova-compute[72990]:   </cpu>
Aug 27 03:41:07 user nova-compute[72990]:   <devices>
Aug 27 03:41:07 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:41:07 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:41:07 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk"/>
Aug 27 03:41:07 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:41:07 user nova-compute[72990]:     </disk>
Aug 27 03:41:07 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:41:07 user nova-compute[72990]:       <mac address="fa:16:3e:b7:4e:53"/>
Aug 27 03:41:07 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:41:07 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:41:07 user nova-compute[72990]:       <target dev="tap48bea006-1d"/>
Aug 27 03:41:07 user nova-compute[72990]:     </interface>
Aug 27 03:41:07 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:41:07 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/console.log" append="off"/>
Aug 27 03:41:07 user nova-compute[72990]:     </serial>
Aug 27 03:41:07 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:41:07 user nova-compute[72990]:     <video>
Aug 27 03:41:07 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:41:07 user nova-compute[72990]:     </video>
Aug 27 03:41:07 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:41:07 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:41:07 user nova-compute[72990]:     </rng>
Aug 27 03:41:07 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:41:07 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:41:07 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:41:07 user nova-compute[72990]:     </memballoon>
Aug 27 03:41:07 user nova-compute[72990]:   </devices>
Aug 27 03:41:07 user nova-compute[72990]: </domain>
Aug 27 03:41:07 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-224545468',display_name='tempest-VolumesAdminNegativeTest-server-224545468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-224545468',id=8,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrvMAWrGSE690SJX2UCJTWj4tFHLTkqnANgUuE1tSUDNQCinv6wyWDM47ESyj9c8qsCifoP2Rh7NNqP2Ujug6A7kim22xdnbYKWOqyYz2HtCUgzmsanWy20N9Ph25x7jw==',key_name='tempest-keypair-1596844096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c8ee9d65a3449cc8793fe94beb962b9',ramdisk_id='',reservation_id='r-on494m0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1331051968',owner_user_name='tempest-VolumesAdminNegativeTest-1331051968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:41:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70e76f4237f8491da1a1003787625936',uuid=bc82cced-9f16-44bc-b9bc-622fa99b1be0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48bea006-1d46-416d-8ab6-99617cdbcb63", "address": "fa:16:3e:b7:4e:53", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bea006-1d", "ovs_interfaceid": "48bea006-1d46-416d-8ab6-99617cdbcb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Converting VIF {"id": "48bea006-1d46-416d-8ab6-99617cdbcb63", "address": "fa:16:3e:b7:4e:53", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bea006-1d", "ovs_interfaceid": "48bea006-1d46-416d-8ab6-99617cdbcb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=48bea006-1d46-416d-8ab6-99617cdbcb63,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bea006-1d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG os_vif [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=48bea006-1d46-416d-8ab6-99617cdbcb63,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bea006-1d') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48bea006-1d, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48bea006-1d, col_values=(('external_ids', {'iface-id': '48bea006-1d46-416d-8ab6-99617cdbcb63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:4e:53', 'vm-uuid': 'bc82cced-9f16-44bc-b9bc-622fa99b1be0'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:07 user nova-compute[72990]: INFO os_vif [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=48bea006-1d46-416d-8ab6-99617cdbcb63,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bea006-1d')
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107667.7735915, 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:41:07 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] VM Resumed (Lifecycle Event)
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-279c5099-220e-485b-823b-c0135a2f0dd7 req-3225a94a-5ab6-486a-b398-349f5008ef4d service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Received event network-vif-plugged-0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-279c5099-220e-485b-823b-c0135a2f0dd7 req-3225a94a-5ab6-486a-b398-349f5008ef4d service nova] Acquiring lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-279c5099-220e-485b-823b-c0135a2f0dd7 req-3225a94a-5ab6-486a-b398-349f5008ef4d service nova] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-279c5099-220e-485b-823b-c0135a2f0dd7 req-3225a94a-5ab6-486a-b398-349f5008ef4d service nova] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-279c5099-220e-485b-823b-c0135a2f0dd7 req-3225a94a-5ab6-486a-b398-349f5008ef4d service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] No waiting events found dispatching network-vif-plugged-0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:41:07 user nova-compute[72990]: WARNING nova.compute.manager [req-279c5099-220e-485b-823b-c0135a2f0dd7 req-3225a94a-5ab6-486a-b398-349f5008ef4d service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Received unexpected event network-vif-plugged-0ac002a5-64fb-40b4-8da9-22b54f104689 for instance with vm_state building and task_state spawning.
Aug 27 03:41:07 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Instance spawned successfully.
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] No VIF found with MAC fa:16:3e:b7:4e:53, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:41:07 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107667.7737467, 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:41:07 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] VM Started (Lifecycle Event)
Aug 27 03:41:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:41:08 user nova-compute[72990]: INFO nova.compute.manager [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Took 11.21 seconds to spawn the instance on the hypervisor.
Aug 27 03:41:08 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:41:08 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:41:08 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:41:08 user nova-compute[72990]: INFO nova.compute.manager [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Took 12.99 seconds to build instance.
Aug 27 03:41:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ef2dabb3-98dd-42e4-b75d-4ad6f7f0e2dd tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.286s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:08 user nova-compute[72990]: DEBUG nova.network.neutron [req-f73ba84d-5fbc-40d6-bd8c-ae5c167fd028 req-42248249-f969-4fd3-aa24-43209e6230fb service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Updated VIF entry in instance network info cache for port 48bea006-1d46-416d-8ab6-99617cdbcb63. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:41:08 user nova-compute[72990]: DEBUG nova.network.neutron [req-f73ba84d-5fbc-40d6-bd8c-ae5c167fd028 req-42248249-f969-4fd3-aa24-43209e6230fb service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Updating instance_info_cache with network_info: [{"id": "48bea006-1d46-416d-8ab6-99617cdbcb63", "address": "fa:16:3e:b7:4e:53", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bea006-1d", "ovs_interfaceid": "48bea006-1d46-416d-8ab6-99617cdbcb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:41:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f73ba84d-5fbc-40d6-bd8c-ae5c167fd028 req-42248249-f969-4fd3-aa24-43209e6230fb service nova] Releasing lock "refresh_cache-bc82cced-9f16-44bc-b9bc-622fa99b1be0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:41:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:10 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:41:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:10 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:41:10 user nova-compute[72990]: INFO nova.compute.claims [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Claim successful on node user
Aug 27 03:41:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:41:11 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:41:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG nova.policy [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7d9a50df59847eb9951ead87499ffb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7bf02a47b04791acfb0c2ef68f8a09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:41:11 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Creating image(s)
Aug 27 03:41:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "/opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "/opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "/opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.217s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.234s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk 1073741824" returned: 0 in 0.063s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.245s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Successfully created port: 201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Cannot resize image /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Ensure instance console log exists: /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107672.69589, bc82cced-9f16-44bc-b9bc-622fa99b1be0 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:41:12 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] VM Resumed (Lifecycle Event)
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:41:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Instance spawned successfully.
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:12 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107672.6991262, bc82cced-9f16-44bc-b9bc-622fa99b1be0 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:41:12 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] VM Started (Lifecycle Event)
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:41:12 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:41:12 user nova-compute[72990]: INFO nova.compute.manager [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Took 11.04 seconds to spawn the instance on the hypervisor.
Aug 27 03:41:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:41:12 user nova-compute[72990]: INFO nova.compute.manager [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Took 12.68 seconds to build instance.
Aug 27 03:41:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5c4e13e9-94e0-475a-886f-32ae704347b8 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.861s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-b90abd49-3e76-4f0b-b8e7-271d6e66adbc req-4e2fa3e6-6c6c-4096-b34b-09aba065e1c9 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b90abd49-3e76-4f0b-b8e7-271d6e66adbc req-4e2fa3e6-6c6c-4096-b34b-09aba065e1c9 service nova] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b90abd49-3e76-4f0b-b8e7-271d6e66adbc req-4e2fa3e6-6c6c-4096-b34b-09aba065e1c9 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b90abd49-3e76-4f0b-b8e7-271d6e66adbc req-4e2fa3e6-6c6c-4096-b34b-09aba065e1c9 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-b90abd49-3e76-4f0b-b8e7-271d6e66adbc req-4e2fa3e6-6c6c-4096-b34b-09aba065e1c9 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] No waiting events found dispatching network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:41:13 user nova-compute[72990]: WARNING nova.compute.manager [req-b90abd49-3e76-4f0b-b8e7-271d6e66adbc req-4e2fa3e6-6c6c-4096-b34b-09aba065e1c9 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received unexpected event network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 for instance with vm_state active and task_state None.
Aug 27 03:41:13 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Successfully updated port: 201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:41:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "refresh_cache-a388d657-a11d-4a63-b7fc-2df799ca72d0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:41:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquired lock "refresh_cache-a388d657-a11d-4a63-b7fc-2df799ca72d0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:41:13 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:41:13 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Updating instance_info_cache with network_info: [{"id": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "address": "fa:16:3e:1d:b5:ae", "network": {"id": "7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-491390485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef7bf02a47b04791acfb0c2ef68f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201b57cf-6d", "ovs_interfaceid": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Releasing lock "refresh_cache-a388d657-a11d-4a63-b7fc-2df799ca72d0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Instance network_info: |[{"id": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "address": "fa:16:3e:1d:b5:ae", "network": {"id": "7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-491390485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef7bf02a47b04791acfb0c2ef68f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201b57cf-6d", "ovs_interfaceid": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Start _get_guest_xml network_info=[{"id": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "address": "fa:16:3e:1d:b5:ae", "network": {"id": "7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-491390485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef7bf02a47b04791acfb0c2ef68f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201b57cf-6d", "ovs_interfaceid": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:41:14 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:41:14 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-757872244',display_name='tempest-TestVolumeSwap-server-757872244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-757872244',id=9,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBB79Li5dPDaozy0ishpPAv31zHsGnQ/xaGTVBbCiswsunHMgfLPOI0me+oWPuowtzMXXlnKhgx1ABiFg+220LtfvqDT0DIdUv+2c78rXcss+nqggSTqSkGq6swjj99H7Q==',key_name='tempest-keypair-514096999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef7bf02a47b04791acfb0c2ef68f8a09',ramdisk_id='',reservation_id='r-37om2svg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1681906464',owner_user_name='tempest-TestVolumeSwap-1681906464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:41:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7d9a50df59847eb9951ead87499ffb0',uuid=a388d657-a11d-4a63-b7fc-2df799ca72d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "address": "fa:16:3e:1d:b5:ae", "network": {"id": "7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-491390485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef7bf02a47b04791acfb0c2ef68f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201b57cf-6d", "ovs_interfaceid": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Converting VIF {"id": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "address": "fa:16:3e:1d:b5:ae", "network": {"id": "7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-491390485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef7bf02a47b04791acfb0c2ef68f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201b57cf-6d", "ovs_interfaceid": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:b5:ae,bridge_name='br-int',has_traffic_filtering=True,id=201b57cf-6d21-45f8-8b60-0aa05a6c24af,network=Network(7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201b57cf-6d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.objects.instance [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lazy-loading 'pci_devices' on Instance uuid a388d657-a11d-4a63-b7fc-2df799ca72d0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:41:14 user nova-compute[72990]:   <uuid>a388d657-a11d-4a63-b7fc-2df799ca72d0</uuid>
Aug 27 03:41:14 user nova-compute[72990]:   <name>instance-00000009</name>
Aug 27 03:41:14 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:41:14 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:41:14 user nova-compute[72990]:   <metadata>
Aug 27 03:41:14 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:41:14 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:41:14 user nova-compute[72990]:       <nova:name>tempest-TestVolumeSwap-server-757872244</nova:name>
Aug 27 03:41:14 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:41:14</nova:creationTime>
Aug 27 03:41:14 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:41:14 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:41:14 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:41:14 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:41:14 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:41:14 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:41:14 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:41:14 user nova-compute[72990]:       <nova:owner>
Aug 27 03:41:14 user nova-compute[72990]:         <nova:user uuid="f7d9a50df59847eb9951ead87499ffb0">tempest-TestVolumeSwap-1681906464-project-member</nova:user>
Aug 27 03:41:14 user nova-compute[72990]:         <nova:project uuid="ef7bf02a47b04791acfb0c2ef68f8a09">tempest-TestVolumeSwap-1681906464</nova:project>
Aug 27 03:41:14 user nova-compute[72990]:       </nova:owner>
Aug 27 03:41:14 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:41:14 user nova-compute[72990]:       <nova:ports>
Aug 27 03:41:14 user nova-compute[72990]:         <nova:port uuid="201b57cf-6d21-45f8-8b60-0aa05a6c24af">
Aug 27 03:41:14 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 03:41:14 user nova-compute[72990]:         </nova:port>
Aug 27 03:41:14 user nova-compute[72990]:       </nova:ports>
Aug 27 03:41:14 user nova-compute[72990]:     </nova:instance>
Aug 27 03:41:14 user nova-compute[72990]:   </metadata>
Aug 27 03:41:14 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:41:14 user nova-compute[72990]:     <system>
Aug 27 03:41:14 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:41:14 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:41:14 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:41:14 user nova-compute[72990]:       <entry name="serial">a388d657-a11d-4a63-b7fc-2df799ca72d0</entry>
Aug 27 03:41:14 user nova-compute[72990]:       <entry name="uuid">a388d657-a11d-4a63-b7fc-2df799ca72d0</entry>
Aug 27 03:41:14 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:41:14 user nova-compute[72990]:     </system>
Aug 27 03:41:14 user nova-compute[72990]:   </sysinfo>
Aug 27 03:41:14 user nova-compute[72990]:   <os>
Aug 27 03:41:14 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:41:14 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:41:14 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:41:14 user nova-compute[72990]:   </os>
Aug 27 03:41:14 user nova-compute[72990]:   <features>
Aug 27 03:41:14 user nova-compute[72990]:     <acpi/>
Aug 27 03:41:14 user nova-compute[72990]:     <apic/>
Aug 27 03:41:14 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:41:14 user nova-compute[72990]:   </features>
Aug 27 03:41:14 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:41:14 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:41:14 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:41:14 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:41:14 user nova-compute[72990]:   </clock>
Aug 27 03:41:14 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:41:14 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:41:14 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:41:14 user nova-compute[72990]:   </cpu>
Aug 27 03:41:14 user nova-compute[72990]:   <devices>
Aug 27 03:41:14 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:41:14 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:41:14 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk"/>
Aug 27 03:41:14 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:41:14 user nova-compute[72990]:     </disk>
Aug 27 03:41:14 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:41:14 user nova-compute[72990]:       <mac address="fa:16:3e:1d:b5:ae"/>
Aug 27 03:41:14 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:41:14 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:41:14 user nova-compute[72990]:       <target dev="tap201b57cf-6d"/>
Aug 27 03:41:14 user nova-compute[72990]:     </interface>
Aug 27 03:41:14 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:41:14 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/console.log" append="off"/>
Aug 27 03:41:14 user nova-compute[72990]:     </serial>
Aug 27 03:41:14 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:41:14 user nova-compute[72990]:     <video>
Aug 27 03:41:14 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:41:14 user nova-compute[72990]:     </video>
Aug 27 03:41:14 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:41:14 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:41:14 user nova-compute[72990]:     </rng>
Aug 27 03:41:14 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:41:14 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:41:14 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:41:14 user nova-compute[72990]:     </memballoon>
Aug 27 03:41:14 user nova-compute[72990]:   </devices>
Aug 27 03:41:14 user nova-compute[72990]: </domain>
Aug 27 03:41:14 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-757872244',display_name='tempest-TestVolumeSwap-server-757872244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-757872244',id=9,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBB79Li5dPDaozy0ishpPAv31zHsGnQ/xaGTVBbCiswsunHMgfLPOI0me+oWPuowtzMXXlnKhgx1ABiFg+220LtfvqDT0DIdUv+2c78rXcss+nqggSTqSkGq6swjj99H7Q==',key_name='tempest-keypair-514096999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef7bf02a47b04791acfb0c2ef68f8a09',ramdisk_id='',reservation_id='r-37om2svg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1681906464',owner_user_name='tempest-TestVolumeSwap-1681906464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:41:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7d9a50df59847eb9951ead87499ffb0',uuid=a388d657-a11d-4a63-b7fc-2df799ca72d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "address": "fa:16:3e:1d:b5:ae", "network": {"id": "7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-491390485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef7bf02a47b04791acfb0c2ef68f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201b57cf-6d", "ovs_interfaceid": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Converting VIF {"id": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "address": "fa:16:3e:1d:b5:ae", "network": {"id": "7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-491390485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef7bf02a47b04791acfb0c2ef68f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201b57cf-6d", "ovs_interfaceid": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:b5:ae,bridge_name='br-int',has_traffic_filtering=True,id=201b57cf-6d21-45f8-8b60-0aa05a6c24af,network=Network(7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201b57cf-6d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG os_vif [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:b5:ae,bridge_name='br-int',has_traffic_filtering=True,id=201b57cf-6d21-45f8-8b60-0aa05a6c24af,network=Network(7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201b57cf-6d') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap201b57cf-6d, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap201b57cf-6d, col_values=(('external_ids', {'iface-id': '201b57cf-6d21-45f8-8b60-0aa05a6c24af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:b5:ae', 'vm-uuid': 'a388d657-a11d-4a63-b7fc-2df799ca72d0'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:14 user nova-compute[72990]: INFO os_vif [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:b5:ae,bridge_name='br-int',has_traffic_filtering=True,id=201b57cf-6d21-45f8-8b60-0aa05a6c24af,network=Network(7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201b57cf-6d')
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] No VIF found with MAC fa:16:3e:1d:b5:ae, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] There are 0 instances to clean {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72990) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 03:41:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:41:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Received event network-changed-201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Refreshing instance network info cache due to event network-changed-201b57cf-6d21-45f8-8b60-0aa05a6c24af. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:41:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] Acquiring lock "refresh_cache-a388d657-a11d-4a63-b7fc-2df799ca72d0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:41:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] Acquired lock "refresh_cache-a388d657-a11d-4a63-b7fc-2df799ca72d0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:41:15 user nova-compute[72990]: DEBUG nova.network.neutron [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Refreshing network info cache for port 201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:41:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG nova.network.neutron [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Updated VIF entry in instance network info cache for port 201b57cf-6d21-45f8-8b60-0aa05a6c24af. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG nova.network.neutron [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Updating instance_info_cache with network_info: [{"id": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "address": "fa:16:3e:1d:b5:ae", "network": {"id": "7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-491390485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef7bf02a47b04791acfb0c2ef68f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201b57cf-6d", "ovs_interfaceid": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] Releasing lock "refresh_cache-a388d657-a11d-4a63-b7fc-2df799ca72d0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] No waiting events found dispatching network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:41:16 user nova-compute[72990]: WARNING nova.compute.manager [req-283ad139-f10b-4f4c-937f-9c52cd8514ce req-3217f919-37ab-411c-b1ca-bd201fd46a91 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received unexpected event network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 for instance with vm_state active and task_state None.
Aug 27 03:41:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:41:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:17 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:41:17 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:41:17 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:41:17 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:41:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:17 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107678.4048455, a388d657-a11d-4a63-b7fc-2df799ca72d0 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:41:18 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] VM Resumed (Lifecycle Event)
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:41:18 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Instance spawned successfully.
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:41:18 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107678.4105835, a388d657-a11d-4a63-b7fc-2df799ca72d0 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:41:18 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] VM Started (Lifecycle Event)
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:41:18 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:41:18 user nova-compute[72990]: INFO nova.compute.manager [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Took 7.09 seconds to spawn the instance on the hypervisor.
Aug 27 03:41:18 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:18 user nova-compute[72990]: INFO nova.compute.manager [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Took 8.44 seconds to build instance.
Aug 27 03:41:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7439439a-1554-4194-ab76-8aa8671f3ce2 tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.661s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG nova.compute.manager [req-f05dcf7b-ddd9-41e1-ab10-bdb7fa541d04 req-dbbfcf61-8571-4348-88e8-08e3c682e69a service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Received event network-vif-plugged-201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f05dcf7b-ddd9-41e1-ab10-bdb7fa541d04 req-dbbfcf61-8571-4348-88e8-08e3c682e69a service nova] Acquiring lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f05dcf7b-ddd9-41e1-ab10-bdb7fa541d04 req-dbbfcf61-8571-4348-88e8-08e3c682e69a service nova] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f05dcf7b-ddd9-41e1-ab10-bdb7fa541d04 req-dbbfcf61-8571-4348-88e8-08e3c682e69a service nova] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:21 user nova-compute[72990]: DEBUG nova.compute.manager [req-f05dcf7b-ddd9-41e1-ab10-bdb7fa541d04 req-dbbfcf61-8571-4348-88e8-08e3c682e69a service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] No waiting events found dispatching network-vif-plugged-201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:41:21 user nova-compute[72990]: WARNING nova.compute.manager [req-f05dcf7b-ddd9-41e1-ab10-bdb7fa541d04 req-dbbfcf61-8571-4348-88e8-08e3c682e69a service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Received unexpected event network-vif-plugged-201b57cf-6d21-45f8-8b60-0aa05a6c24af for instance with vm_state active and task_state None.
Aug 27 03:41:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Acquiring lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:41:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:41:22 user nova-compute[72990]: INFO nova.compute.claims [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Claim successful on node user
Aug 27 03:41:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:23 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:41:23 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:41:23 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7395MB free_disk=25.677078247070312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-4c41985a-6e7e-4bf2-87f7-02b98418d537 req-e00af590-3424-42b5-a4c2-8140e0fc7a79 service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Received event network-vif-plugged-201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4c41985a-6e7e-4bf2-87f7-02b98418d537 req-e00af590-3424-42b5-a4c2-8140e0fc7a79 service nova] Acquiring lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4c41985a-6e7e-4bf2-87f7-02b98418d537 req-e00af590-3424-42b5-a4c2-8140e0fc7a79 service nova] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4c41985a-6e7e-4bf2-87f7-02b98418d537 req-e00af590-3424-42b5-a4c2-8140e0fc7a79 service nova] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-4c41985a-6e7e-4bf2-87f7-02b98418d537 req-e00af590-3424-42b5-a4c2-8140e0fc7a79 service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] No waiting events found dispatching network-vif-plugged-201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:41:23 user nova-compute[72990]: WARNING nova.compute.manager [req-4c41985a-6e7e-4bf2-87f7-02b98418d537 req-e00af590-3424-42b5-a4c2-8140e0fc7a79 service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Received unexpected event network-vif-plugged-201b57cf-6d21-45f8-8b60-0aa05a6c24af for instance with vm_state active and task_state None.
Aug 27 03:41:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.378s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:41:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.176s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.network.neutron [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:41:24 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bc82cced-9f16-44bc-b9bc-622fa99b1be0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 970ca110-30d7-4e41-92d3-aa4e0bda4482 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance a388d657-a11d-4a63-b7fc-2df799ca72d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing inventories for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.policy [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a99be1360244389ae77eaf6fc5249ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61380783bd4439a0f3205d0e5cfa1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating ProviderTree inventory for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating inventory in ProviderTree for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing aggregate associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, aggregates: None {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing trait associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:41:24 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Creating image(s)
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "/opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "/opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.038s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.256s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk 1073741824" returned: 0 in 0.065s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:24 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Successfully created port: 75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.098s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.224s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Cannot resize image /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Ensure instance console log exists: /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Successfully updated port: 75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Acquiring lock "refresh_cache-a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Acquired lock "refresh_cache-a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-8572e689-06ca-4870-a12e-42e7f367295f req-9ae1497c-fe2a-4abe-8013-5f3a2b5d4d0b service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Received event network-changed-75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-8572e689-06ca-4870-a12e-42e7f367295f req-9ae1497c-fe2a-4abe-8013-5f3a2b5d4d0b service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Refreshing instance network info cache due to event network-changed-75916180-ab9a-4930-9c30-b2b67b3284d3. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8572e689-06ca-4870-a12e-42e7f367295f req-9ae1497c-fe2a-4abe-8013-5f3a2b5d4d0b service nova] Acquiring lock "refresh_cache-a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:41:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Skipping network cache update for instance because it is Building. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Updating instance_info_cache with network_info: [{"id": "75916180-ab9a-4930-9c30-b2b67b3284d3", "address": "fa:16:3e:ca:eb:1e", "network": {"id": "681b81c3-eae5-44a6-8cc5-f75f95fd1a40", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1610213912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc61380783bd4439a0f3205d0e5cfa1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75916180-ab", "ovs_interfaceid": "75916180-ab9a-4930-9c30-b2b67b3284d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Releasing lock "refresh_cache-a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Instance network_info: |[{"id": "75916180-ab9a-4930-9c30-b2b67b3284d3", "address": "fa:16:3e:ca:eb:1e", "network": {"id": "681b81c3-eae5-44a6-8cc5-f75f95fd1a40", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1610213912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc61380783bd4439a0f3205d0e5cfa1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75916180-ab", "ovs_interfaceid": "75916180-ab9a-4930-9c30-b2b67b3284d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8572e689-06ca-4870-a12e-42e7f367295f req-9ae1497c-fe2a-4abe-8013-5f3a2b5d4d0b service nova] Acquired lock "refresh_cache-a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-8572e689-06ca-4870-a12e-42e7f367295f req-9ae1497c-fe2a-4abe-8013-5f3a2b5d4d0b service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Refreshing network info cache for port 75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Start _get_guest_xml network_info=[{"id": "75916180-ab9a-4930-9c30-b2b67b3284d3", "address": "fa:16:3e:ca:eb:1e", "network": {"id": "681b81c3-eae5-44a6-8cc5-f75f95fd1a40", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1610213912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc61380783bd4439a0f3205d0e5cfa1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75916180-ab", "ovs_interfaceid": "75916180-ab9a-4930-9c30-b2b67b3284d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:41:26 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:41:26 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1468368321',display_name='tempest-VolumesAssistedSnapshotsTest-server-1468368321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1468368321',id=10,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoq63sBKCN7VC2v5UiTw0Sj3REf1W80UyKZckQWDC7NAXd1AsGs9h4dQSTavtTHMQBtWPAHgaHEdhy99dxCDybKZ44vfFYJFi0tz1Nbs9wqSBfbwE5I/K97NVLH6xrwZw==',key_name='tempest-keypair-1884002227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc61380783bd4439a0f3205d0e5cfa1c',ramdisk_id='',reservation_id='r-1m5xovf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-683201497',owner_user_name='tempest-VolumesAssistedSnapshotsTest-683201497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a99be1360244389ae77eaf6fc5249ed',uuid=a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75916180-ab9a-4930-9c30-b2b67b3284d3", "address": "fa:16:3e:ca:eb:1e", "network": {"id": "681b81c3-eae5-44a6-8cc5-f75f95fd1a40", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1610213912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc61380783bd4439a0f3205d0e5cfa1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75916180-ab", "ovs_interfaceid": "75916180-ab9a-4930-9c30-b2b67b3284d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Converting VIF {"id": "75916180-ab9a-4930-9c30-b2b67b3284d3", "address": "fa:16:3e:ca:eb:1e", "network": {"id": "681b81c3-eae5-44a6-8cc5-f75f95fd1a40", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1610213912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc61380783bd4439a0f3205d0e5cfa1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75916180-ab", "ovs_interfaceid": "75916180-ab9a-4930-9c30-b2b67b3284d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:eb:1e,bridge_name='br-int',has_traffic_filtering=True,id=75916180-ab9a-4930-9c30-b2b67b3284d3,network=Network(681b81c3-eae5-44a6-8cc5-f75f95fd1a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75916180-ab') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.objects.instance [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lazy-loading 'pci_devices' on Instance uuid a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:41:26 user nova-compute[72990]:   <uuid>a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63</uuid>
Aug 27 03:41:26 user nova-compute[72990]:   <name>instance-0000000a</name>
Aug 27 03:41:26 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:41:26 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:41:26 user nova-compute[72990]:   <metadata>
Aug 27 03:41:26 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:41:26 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:41:26 user nova-compute[72990]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1468368321</nova:name>
Aug 27 03:41:26 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:41:26</nova:creationTime>
Aug 27 03:41:26 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:41:26 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:41:26 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:41:26 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:41:26 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:41:26 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:41:26 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:41:26 user nova-compute[72990]:       <nova:owner>
Aug 27 03:41:26 user nova-compute[72990]:         <nova:user uuid="7a99be1360244389ae77eaf6fc5249ed">tempest-VolumesAssistedSnapshotsTest-683201497-project-member</nova:user>
Aug 27 03:41:26 user nova-compute[72990]:         <nova:project uuid="cc61380783bd4439a0f3205d0e5cfa1c">tempest-VolumesAssistedSnapshotsTest-683201497</nova:project>
Aug 27 03:41:26 user nova-compute[72990]:       </nova:owner>
Aug 27 03:41:26 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:41:26 user nova-compute[72990]:       <nova:ports>
Aug 27 03:41:26 user nova-compute[72990]:         <nova:port uuid="75916180-ab9a-4930-9c30-b2b67b3284d3">
Aug 27 03:41:26 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 03:41:26 user nova-compute[72990]:         </nova:port>
Aug 27 03:41:26 user nova-compute[72990]:       </nova:ports>
Aug 27 03:41:26 user nova-compute[72990]:     </nova:instance>
Aug 27 03:41:26 user nova-compute[72990]:   </metadata>
Aug 27 03:41:26 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:41:26 user nova-compute[72990]:     <system>
Aug 27 03:41:26 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:41:26 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:41:26 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:41:26 user nova-compute[72990]:       <entry name="serial">a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63</entry>
Aug 27 03:41:26 user nova-compute[72990]:       <entry name="uuid">a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63</entry>
Aug 27 03:41:26 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:41:26 user nova-compute[72990]:     </system>
Aug 27 03:41:26 user nova-compute[72990]:   </sysinfo>
Aug 27 03:41:26 user nova-compute[72990]:   <os>
Aug 27 03:41:26 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:41:26 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:41:26 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:41:26 user nova-compute[72990]:   </os>
Aug 27 03:41:26 user nova-compute[72990]:   <features>
Aug 27 03:41:26 user nova-compute[72990]:     <acpi/>
Aug 27 03:41:26 user nova-compute[72990]:     <apic/>
Aug 27 03:41:26 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:41:26 user nova-compute[72990]:   </features>
Aug 27 03:41:26 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:41:26 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:41:26 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:41:26 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:41:26 user nova-compute[72990]:   </clock>
Aug 27 03:41:26 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:41:26 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:41:26 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:41:26 user nova-compute[72990]:   </cpu>
Aug 27 03:41:26 user nova-compute[72990]:   <devices>
Aug 27 03:41:26 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:41:26 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:41:26 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk"/>
Aug 27 03:41:26 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:41:26 user nova-compute[72990]:     </disk>
Aug 27 03:41:26 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:41:26 user nova-compute[72990]:       <mac address="fa:16:3e:ca:eb:1e"/>
Aug 27 03:41:26 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:41:26 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:41:26 user nova-compute[72990]:       <target dev="tap75916180-ab"/>
Aug 27 03:41:26 user nova-compute[72990]:     </interface>
Aug 27 03:41:26 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:41:26 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/console.log" append="off"/>
Aug 27 03:41:26 user nova-compute[72990]:     </serial>
Aug 27 03:41:26 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:41:26 user nova-compute[72990]:     <video>
Aug 27 03:41:26 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:41:26 user nova-compute[72990]:     </video>
Aug 27 03:41:26 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:41:26 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:41:26 user nova-compute[72990]:     </rng>
Aug 27 03:41:26 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:41:26 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:41:26 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:41:26 user nova-compute[72990]:     </memballoon>
Aug 27 03:41:26 user nova-compute[72990]:   </devices>
Aug 27 03:41:26 user nova-compute[72990]: </domain>
Aug 27 03:41:26 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1468368321',display_name='tempest-VolumesAssistedSnapshotsTest-server-1468368321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1468368321',id=10,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoq63sBKCN7VC2v5UiTw0Sj3REf1W80UyKZckQWDC7NAXd1AsGs9h4dQSTavtTHMQBtWPAHgaHEdhy99dxCDybKZ44vfFYJFi0tz1Nbs9wqSBfbwE5I/K97NVLH6xrwZw==',key_name='tempest-keypair-1884002227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc61380783bd4439a0f3205d0e5cfa1c',ramdisk_id='',reservation_id='r-1m5xovf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-683201497',owner_user_name='tempest-VolumesAssistedSnapshotsTest-683201497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a99be1360244389ae77eaf6fc5249ed',uuid=a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75916180-ab9a-4930-9c30-b2b67b3284d3", "address": "fa:16:3e:ca:eb:1e", "network": {"id": "681b81c3-eae5-44a6-8cc5-f75f95fd1a40", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1610213912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc61380783bd4439a0f3205d0e5cfa1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75916180-ab", "ovs_interfaceid": "75916180-ab9a-4930-9c30-b2b67b3284d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Converting VIF {"id": "75916180-ab9a-4930-9c30-b2b67b3284d3", "address": "fa:16:3e:ca:eb:1e", "network": {"id": "681b81c3-eae5-44a6-8cc5-f75f95fd1a40", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1610213912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc61380783bd4439a0f3205d0e5cfa1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75916180-ab", "ovs_interfaceid": "75916180-ab9a-4930-9c30-b2b67b3284d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:eb:1e,bridge_name='br-int',has_traffic_filtering=True,id=75916180-ab9a-4930-9c30-b2b67b3284d3,network=Network(681b81c3-eae5-44a6-8cc5-f75f95fd1a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75916180-ab') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG os_vif [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:eb:1e,bridge_name='br-int',has_traffic_filtering=True,id=75916180-ab9a-4930-9c30-b2b67b3284d3,network=Network(681b81c3-eae5-44a6-8cc5-f75f95fd1a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75916180-ab') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75916180-ab, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75916180-ab, col_values=(('external_ids', {'iface-id': '75916180-ab9a-4930-9c30-b2b67b3284d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:eb:1e', 'vm-uuid': 'a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:26 user nova-compute[72990]: INFO os_vif [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:eb:1e,bridge_name='br-int',has_traffic_filtering=True,id=75916180-ab9a-4930-9c30-b2b67b3284d3,network=Network(681b81c3-eae5-44a6-8cc5-f75f95fd1a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75916180-ab')
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] No VIF found with MAC fa:16:3e:ca:eb:1e, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Updating instance_info_cache with network_info: [{"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-8572e689-06ca-4870-a12e-42e7f367295f req-9ae1497c-fe2a-4abe-8013-5f3a2b5d4d0b service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Updated VIF entry in instance network info cache for port 75916180-ab9a-4930-9c30-b2b67b3284d3. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-8572e689-06ca-4870-a12e-42e7f367295f req-9ae1497c-fe2a-4abe-8013-5f3a2b5d4d0b service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Updating instance_info_cache with network_info: [{"id": "75916180-ab9a-4930-9c30-b2b67b3284d3", "address": "fa:16:3e:ca:eb:1e", "network": {"id": "681b81c3-eae5-44a6-8cc5-f75f95fd1a40", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1610213912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc61380783bd4439a0f3205d0e5cfa1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75916180-ab", "ovs_interfaceid": "75916180-ab9a-4930-9c30-b2b67b3284d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:41:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8572e689-06ca-4870-a12e-42e7f367295f req-9ae1497c-fe2a-4abe-8013-5f3a2b5d4d0b service nova] Releasing lock "refresh_cache-a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:41:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-cf4fa3f1-eddc-4b8a-8534-515d1c1a7c12 req-68bd79c6-b096-487f-9662-55cf054ecda1 service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Received event network-vif-plugged-75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cf4fa3f1-eddc-4b8a-8534-515d1c1a7c12 req-68bd79c6-b096-487f-9662-55cf054ecda1 service nova] Acquiring lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cf4fa3f1-eddc-4b8a-8534-515d1c1a7c12 req-68bd79c6-b096-487f-9662-55cf054ecda1 service nova] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cf4fa3f1-eddc-4b8a-8534-515d1c1a7c12 req-68bd79c6-b096-487f-9662-55cf054ecda1 service nova] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-cf4fa3f1-eddc-4b8a-8534-515d1c1a7c12 req-68bd79c6-b096-487f-9662-55cf054ecda1 service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] No waiting events found dispatching network-vif-plugged-75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:41:28 user nova-compute[72990]: WARNING nova.compute.manager [req-cf4fa3f1-eddc-4b8a-8534-515d1c1a7c12 req-68bd79c6-b096-487f-9662-55cf054ecda1 service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Received unexpected event network-vif-plugged-75916180-ab9a-4930-9c30-b2b67b3284d3 for instance with vm_state building and task_state spawning.
Aug 27 03:41:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107690.616235, a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:41:30 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] VM Resumed (Lifecycle Event)
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:41:30 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Instance spawned successfully.
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:41:30 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107690.6167808, a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:41:30 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] VM Started (Lifecycle Event)
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:41:30 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:41:30 user nova-compute[72990]: INFO nova.compute.manager [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:41:30 user nova-compute[72990]: INFO nova.compute.manager [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Took 8.35 seconds to build instance.
Aug 27 03:41:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15172e17-e909-456e-bfde-28fbf3fdc23f tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.511s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-cc5a04bc-dd81-46d4-a710-1f3ece0172f2 req-22daf3fe-deac-4407-9c45-b7e16911605e service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Received event network-vif-plugged-75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cc5a04bc-dd81-46d4-a710-1f3ece0172f2 req-22daf3fe-deac-4407-9c45-b7e16911605e service nova] Acquiring lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cc5a04bc-dd81-46d4-a710-1f3ece0172f2 req-22daf3fe-deac-4407-9c45-b7e16911605e service nova] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cc5a04bc-dd81-46d4-a710-1f3ece0172f2 req-22daf3fe-deac-4407-9c45-b7e16911605e service nova] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:41:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-cc5a04bc-dd81-46d4-a710-1f3ece0172f2 req-22daf3fe-deac-4407-9c45-b7e16911605e service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] No waiting events found dispatching network-vif-plugged-75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:41:30 user nova-compute[72990]: WARNING nova.compute.manager [req-cc5a04bc-dd81-46d4-a710-1f3ece0172f2 req-22daf3fe-deac-4407-9c45-b7e16911605e service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Received unexpected event network-vif-plugged-75916180-ab9a-4930-9c30-b2b67b3284d3 for instance with vm_state active and task_state None.
Aug 27 03:41:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:41:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:42:14 user nova-compute[72990]: INFO nova.compute.manager [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] instance snapshotting
Aug 27 03:42:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Beginning live snapshot process
Aug 27 03:42:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json -f qcow2 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json -f qcow2 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsajfx50i/346740d984e54e11a4affc2df491d77f.delta 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsajfx50i/346740d984e54e11a4affc2df491d77f.delta 1073741824" returned: 0 in 0.045s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:15 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 03:42:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72990) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 27 03:42:15 user nova-compute[72990]: INFO nova.virt.libvirt.host [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] UEFI support detected
Aug 27 03:42:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:42:16 user nova-compute[72990]: INFO nova.compute.manager [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Rescuing
Aug 27 03:42:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquired lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:16 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:42:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:42:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:42:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:42:16 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 03:42:17 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsajfx50i/346740d984e54e11a4affc2df491d77f.delta /opt/stack/data/nova/instances/snapshots/tmpsajfx50i/346740d984e54e11a4affc2df491d77f {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Updating instance_info_cache with network_info: [{"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Releasing lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsajfx50i/346740d984e54e11a4affc2df491d77f.delta /opt/stack/data/nova/instances/snapshots/tmpsajfx50i/346740d984e54e11a4affc2df491d77f" returned: 0 in 0.457s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:17 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Snapshot extracted, beginning image upload
Aug 27 03:42:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-e4b3e5e7-83f3-4863-a6bf-e51aea8f86ef req-9c6246c4-39dc-46a9-ab11-6e8e9d795a74 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received event network-vif-unplugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e4b3e5e7-83f3-4863-a6bf-e51aea8f86ef req-9c6246c4-39dc-46a9-ab11-6e8e9d795a74 service nova] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e4b3e5e7-83f3-4863-a6bf-e51aea8f86ef req-9c6246c4-39dc-46a9-ab11-6e8e9d795a74 service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e4b3e5e7-83f3-4863-a6bf-e51aea8f86ef req-9c6246c4-39dc-46a9-ab11-6e8e9d795a74 service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-e4b3e5e7-83f3-4863-a6bf-e51aea8f86ef req-9c6246c4-39dc-46a9-ab11-6e8e9d795a74 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] No waiting events found dispatching network-vif-unplugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:42:17 user nova-compute[72990]: WARNING nova.compute.manager [req-e4b3e5e7-83f3-4863-a6bf-e51aea8f86ef req-9c6246c4-39dc-46a9-ab11-6e8e9d795a74 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received unexpected event network-vif-unplugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c for instance with vm_state active and task_state rescuing.
Aug 27 03:42:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:18 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Instance destroyed successfully.
Aug 27 03:42:18 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Attempting rescue
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72990) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Instance directory exists: not creating {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 03:42:18 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Creating image(s)
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "/opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "/opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue" returned: 0 in 0.083s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'migration_context' on Instance uuid 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.objects.base [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<8ff6c50a-eb4e-4d5a-a213-4fbd7598234f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Start _get_guest_xml network_info=[{"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "vif_mac": "fa:16:3e:df:7e:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'resources' on Instance uuid 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.objects.base [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<8ff6c50a-eb4e-4d5a-a213-4fbd7598234f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.objects.base [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<8ff6c50a-eb4e-4d5a-a213-4fbd7598234f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:42:18 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:42:18 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.objects.base [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<8ff6c50a-eb4e-4d5a-a213-4fbd7598234f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-750776012',display_name='tempest-ServerRescueNegativeTestJSON-server-750776012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-750776012',id=3,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:40:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='567ed48c72c547c6984851d6ba37e780',ramdisk_id='',reservation_id='r-7it4e73j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-311406621',owner_user_name='tempest-ServerRescueNegativeTestJSON-311406621-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:43Z,user_data=None,user_id='f0631ab8ad8648e2912d4e554fbbe195',uuid=8ff6c50a-eb4e-4d5a-a213-4fbd7598234f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "vif_mac": "fa:16:3e:df:7e:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converting VIF {"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "vif_mac": "fa:16:3e:df:7e:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:7e:fa,bridge_name='br-int',has_traffic_filtering=True,id=eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb0ae47f-f2') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.objects.base [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<8ff6c50a-eb4e-4d5a-a213-4fbd7598234f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:42:18 user nova-compute[72990]:   <uuid>8ff6c50a-eb4e-4d5a-a213-4fbd7598234f</uuid>
Aug 27 03:42:18 user nova-compute[72990]:   <name>instance-00000003</name>
Aug 27 03:42:18 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:42:18 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:42:18 user nova-compute[72990]:   <metadata>
Aug 27 03:42:18 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:42:18 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:42:18 user nova-compute[72990]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-750776012</nova:name>
Aug 27 03:42:18 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:42:18</nova:creationTime>
Aug 27 03:42:18 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:42:18 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:42:18 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:42:18 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:42:18 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:42:18 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:42:18 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:42:18 user nova-compute[72990]:       <nova:owner>
Aug 27 03:42:18 user nova-compute[72990]:         <nova:user uuid="f0631ab8ad8648e2912d4e554fbbe195">tempest-ServerRescueNegativeTestJSON-311406621-project-member</nova:user>
Aug 27 03:42:18 user nova-compute[72990]:         <nova:project uuid="567ed48c72c547c6984851d6ba37e780">tempest-ServerRescueNegativeTestJSON-311406621</nova:project>
Aug 27 03:42:18 user nova-compute[72990]:       </nova:owner>
Aug 27 03:42:18 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:42:18 user nova-compute[72990]:       <nova:ports>
Aug 27 03:42:18 user nova-compute[72990]:         <nova:port uuid="eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c">
Aug 27 03:42:18 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 03:42:18 user nova-compute[72990]:         </nova:port>
Aug 27 03:42:18 user nova-compute[72990]:       </nova:ports>
Aug 27 03:42:18 user nova-compute[72990]:     </nova:instance>
Aug 27 03:42:18 user nova-compute[72990]:   </metadata>
Aug 27 03:42:18 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:42:18 user nova-compute[72990]:     <system>
Aug 27 03:42:18 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:42:18 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:42:18 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:42:18 user nova-compute[72990]:       <entry name="serial">8ff6c50a-eb4e-4d5a-a213-4fbd7598234f</entry>
Aug 27 03:42:18 user nova-compute[72990]:       <entry name="uuid">8ff6c50a-eb4e-4d5a-a213-4fbd7598234f</entry>
Aug 27 03:42:18 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:42:18 user nova-compute[72990]:     </system>
Aug 27 03:42:18 user nova-compute[72990]:   </sysinfo>
Aug 27 03:42:18 user nova-compute[72990]:   <os>
Aug 27 03:42:18 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:42:18 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:42:18 user nova-compute[72990]:   </os>
Aug 27 03:42:18 user nova-compute[72990]:   <features>
Aug 27 03:42:18 user nova-compute[72990]:     <acpi/>
Aug 27 03:42:18 user nova-compute[72990]:     <apic/>
Aug 27 03:42:18 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:42:18 user nova-compute[72990]:   </features>
Aug 27 03:42:18 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:42:18 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:42:18 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:42:18 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:42:18 user nova-compute[72990]:   </clock>
Aug 27 03:42:18 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:42:18 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:42:18 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:42:18 user nova-compute[72990]:   </cpu>
Aug 27 03:42:18 user nova-compute[72990]:   <devices>
Aug 27 03:42:18 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:42:18 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:42:18 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue"/>
Aug 27 03:42:18 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:42:18 user nova-compute[72990]:     </disk>
Aug 27 03:42:18 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:42:18 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:42:18 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk"/>
Aug 27 03:42:18 user nova-compute[72990]:       <target dev="vdb" bus="virtio"/>
Aug 27 03:42:18 user nova-compute[72990]:     </disk>
Aug 27 03:42:18 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:42:18 user nova-compute[72990]:       <mac address="fa:16:3e:df:7e:fa"/>
Aug 27 03:42:18 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:42:18 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:42:18 user nova-compute[72990]:       <target dev="tapeb0ae47f-f2"/>
Aug 27 03:42:18 user nova-compute[72990]:     </interface>
Aug 27 03:42:18 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:42:18 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/console.log" append="off"/>
Aug 27 03:42:18 user nova-compute[72990]:     </serial>
Aug 27 03:42:18 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:42:18 user nova-compute[72990]:     <video>
Aug 27 03:42:18 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:42:18 user nova-compute[72990]:     </video>
Aug 27 03:42:18 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:42:18 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:42:18 user nova-compute[72990]:     </rng>
Aug 27 03:42:18 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:42:18 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:42:18 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:42:18 user nova-compute[72990]:     </memballoon>
Aug 27 03:42:18 user nova-compute[72990]:   </devices>
Aug 27 03:42:18 user nova-compute[72990]: </domain>
Aug 27 03:42:18 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:42:18 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Instance destroyed successfully.
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No VIF found with MAC fa:16:3e:df:7e:fa, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:42:19 user nova-compute[72990]: INFO nova.compute.claims [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Claim successful on node user
Aug 27 03:42:19 user nova-compute[72990]: DEBUG nova.compute.manager [req-88e0d83d-d1c1-4c55-a3a7-dfaba0706242 req-47dcd53d-85d8-4b82-9958-6b55a64c7640 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received event network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-88e0d83d-d1c1-4c55-a3a7-dfaba0706242 req-47dcd53d-85d8-4b82-9958-6b55a64c7640 service nova] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-88e0d83d-d1c1-4c55-a3a7-dfaba0706242 req-47dcd53d-85d8-4b82-9958-6b55a64c7640 service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-88e0d83d-d1c1-4c55-a3a7-dfaba0706242 req-47dcd53d-85d8-4b82-9958-6b55a64c7640 service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG nova.compute.manager [req-88e0d83d-d1c1-4c55-a3a7-dfaba0706242 req-47dcd53d-85d8-4b82-9958-6b55a64c7640 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] No waiting events found dispatching network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:42:19 user nova-compute[72990]: WARNING nova.compute.manager [req-88e0d83d-d1c1-4c55-a3a7-dfaba0706242 req-47dcd53d-85d8-4b82-9958-6b55a64c7640 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received unexpected event network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c for instance with vm_state active and task_state rescuing.
Aug 27 03:42:19 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:42:19 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:42:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:42:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:42:20 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:42:20 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:42:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:42:20 user nova-compute[72990]: DEBUG nova.policy [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '295b1d8849c64318b96d69a4ce248a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185df0487c2245a5a764f2006dec8341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:42:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:20 user nova-compute[72990]: INFO nova.virt.block_device [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Booting with volume d3c79c6f-3849-465f-9826-78c35675890c at /dev/vda
Aug 27 03:42:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:20 user nova-compute[72990]: DEBUG os_brick.utils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:42:20 user nova-compute[72990]: INFO oslo.privsep.daemon [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp_ju47dw_/privsep.sock']
Aug 27 03:42:20 user sudo[84568]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp_ju47dw_/privsep.sock
Aug 27 03:42:20 user sudo[84568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 03:42:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:20 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Snapshot image upload complete
Aug 27 03:42:20 user nova-compute[72990]: INFO nova.compute.manager [None req-c0a7f025-7073-4afc-ad2e-6074fab000a4 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Took 6.07 seconds to snapshot the instance on the hypervisor.
Aug 27 03:42:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Successfully created port: 37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1f41cf2-b9f5-40af-8a54-88ab09e919fc req-050a2270-a140-4a0e-8091-abcf5d7993c5 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received event network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1f41cf2-b9f5-40af-8a54-88ab09e919fc req-050a2270-a140-4a0e-8091-abcf5d7993c5 service nova] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1f41cf2-b9f5-40af-8a54-88ab09e919fc req-050a2270-a140-4a0e-8091-abcf5d7993c5 service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1f41cf2-b9f5-40af-8a54-88ab09e919fc req-050a2270-a140-4a0e-8091-abcf5d7993c5 service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1f41cf2-b9f5-40af-8a54-88ab09e919fc req-050a2270-a140-4a0e-8091-abcf5d7993c5 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] No waiting events found dispatching network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:42:21 user nova-compute[72990]: WARNING nova.compute.manager [req-f1f41cf2-b9f5-40af-8a54-88ab09e919fc req-050a2270-a140-4a0e-8091-abcf5d7993c5 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received unexpected event network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c for instance with vm_state active and task_state rescuing.
Aug 27 03:42:21 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1f41cf2-b9f5-40af-8a54-88ab09e919fc req-050a2270-a140-4a0e-8091-abcf5d7993c5 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received event network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1f41cf2-b9f5-40af-8a54-88ab09e919fc req-050a2270-a140-4a0e-8091-abcf5d7993c5 service nova] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1f41cf2-b9f5-40af-8a54-88ab09e919fc req-050a2270-a140-4a0e-8091-abcf5d7993c5 service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1f41cf2-b9f5-40af-8a54-88ab09e919fc req-050a2270-a140-4a0e-8091-abcf5d7993c5 service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1f41cf2-b9f5-40af-8a54-88ab09e919fc req-050a2270-a140-4a0e-8091-abcf5d7993c5 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] No waiting events found dispatching network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:42:21 user nova-compute[72990]: WARNING nova.compute.manager [req-f1f41cf2-b9f5-40af-8a54-88ab09e919fc req-050a2270-a140-4a0e-8091-abcf5d7993c5 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received unexpected event network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c for instance with vm_state active and task_state rescuing.
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Successfully created port: 515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:22 user sudo[84568]: pam_unix(sudo:session): session closed for user root
Aug 27 03:42:22 user nova-compute[72990]: INFO oslo.privsep.daemon [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Spawned new privsep daemon via rootwrap
Aug 27 03:42:22 user nova-compute[72990]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 03:42:22 user nova-compute[72990]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 03:42:22 user nova-compute[72990]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 27 03:42:22 user nova-compute[72990]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84652
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b12943f-c639-4c90-8a0f-1fa43664514e]: (2,) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Successfully created port: 431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[437e58fc-4e85-41b3-8c70-5c4c83ddc7e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:22 user nova-compute[72990]: WARNING os_brick.initiator.connectors.nvmeof [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f123cd7-4b0d-4065-8d6a-b57070f81dcc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Removed pending event for 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f due to event {{(pid=72990) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107742.6936452, 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:42:22 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] VM Resumed (Lifecycle Event)
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a30818-2ddb-4deb-a73e-1d647d047a89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2fbde077-185a-454a-b8c9-645d2fcd27b2 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9ac89a-8dd0-442b-b13d-c6901f6961fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:42:22 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8ad163-db84-4910-908f-ef5d4ad4ba44]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG os_brick.utils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] <== get_connector_properties: return (2300ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating existing volume attachment record: 5ddcf7a8-b004-4cf0-82be-6b281c7c0911 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107742.7041936, 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:42:22 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] VM Started (Lifecycle Event)
Aug 27 03:42:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:42:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:42:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Successfully created port: cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:42:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:24 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Successfully created port: fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:42:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:24 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Successfully updated port: 37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-6572101e-d7fe-4466-a8a1-f22cf5387891 req-e4566864-2c72-476c-9caf-e829a8a17657 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-changed-37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-6572101e-d7fe-4466-a8a1-f22cf5387891 req-e4566864-2c72-476c-9caf-e829a8a17657 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing instance network info cache due to event network-changed-37ba863e-2224-43c9-8b0e-76d42e1ec9ac. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6572101e-d7fe-4466-a8a1-f22cf5387891 req-e4566864-2c72-476c-9caf-e829a8a17657 service nova] Acquiring lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6572101e-d7fe-4466-a8a1-f22cf5387891 req-e4566864-2c72-476c-9caf-e829a8a17657 service nova] Acquired lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.network.neutron [req-6572101e-d7fe-4466-a8a1-f22cf5387891 req-e4566864-2c72-476c-9caf-e829a8a17657 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing network info cache for port 37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:25 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:42:25 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7069MB free_disk=25.52621078491211GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bc82cced-9f16-44bc-b9bc-622fa99b1be0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bbab26b4-9515-4427-a01c-04f4a85b1fa8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 970ca110-30d7-4e41-92d3-aa4e0bda4482 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance a388d657-a11d-4a63-b7fc-2df799ca72d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:42:25 user nova-compute[72990]: DEBUG nova.network.neutron [req-6572101e-d7fe-4466-a8a1-f22cf5387891 req-e4566864-2c72-476c-9caf-e829a8a17657 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-6572101e-d7fe-4466-a8a1-f22cf5387891 req-e4566864-2c72-476c-9caf-e829a8a17657 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6572101e-d7fe-4466-a8a1-f22cf5387891 req-e4566864-2c72-476c-9caf-e829a8a17657 service nova] Releasing lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Successfully updated port: 3317df18-83e4-4bba-9edb-ca6db2cc4295 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-3bd13fd0-5349-4250-aa96-f8a0c44b4b93 req-00d331f3-d6d8-441d-a1fe-1af3e2a960ca service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-changed-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-3bd13fd0-5349-4250-aa96-f8a0c44b4b93 req-00d331f3-d6d8-441d-a1fe-1af3e2a960ca service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Refreshing instance network info cache due to event network-changed-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3bd13fd0-5349-4250-aa96-f8a0c44b4b93 req-00d331f3-d6d8-441d-a1fe-1af3e2a960ca service nova] Acquiring lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3bd13fd0-5349-4250-aa96-f8a0c44b4b93 req-00d331f3-d6d8-441d-a1fe-1af3e2a960ca service nova] Acquired lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-3bd13fd0-5349-4250-aa96-f8a0c44b4b93 req-00d331f3-d6d8-441d-a1fe-1af3e2a960ca service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Refreshing network info cache for port eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-79bc387e-858a-43c9-9061-cbbb80b51ac9 req-092d0f81-aad4-4306-b6ca-6cdcebfcac37 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-changed-3317df18-83e4-4bba-9edb-ca6db2cc4295 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-79bc387e-858a-43c9-9061-cbbb80b51ac9 req-092d0f81-aad4-4306-b6ca-6cdcebfcac37 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing instance network info cache due to event network-changed-3317df18-83e4-4bba-9edb-ca6db2cc4295. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-79bc387e-858a-43c9-9061-cbbb80b51ac9 req-092d0f81-aad4-4306-b6ca-6cdcebfcac37 service nova] Acquiring lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-79bc387e-858a-43c9-9061-cbbb80b51ac9 req-092d0f81-aad4-4306-b6ca-6cdcebfcac37 service nova] Acquired lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-79bc387e-858a-43c9-9061-cbbb80b51ac9 req-092d0f81-aad4-4306-b6ca-6cdcebfcac37 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing network info cache for port 3317df18-83e4-4bba-9edb-ca6db2cc4295 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:42:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:42:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:42:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:42:27 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Successfully updated port: cbf96d51-1d93-4bcf-9292-fc6eaa08b461 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:42:27 user nova-compute[72990]: DEBUG nova.network.neutron [req-79bc387e-858a-43c9-9061-cbbb80b51ac9 req-092d0f81-aad4-4306-b6ca-6cdcebfcac37 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:42:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:27 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:42:28 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Successfully updated port: 515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:42:28 user nova-compute[72990]: DEBUG nova.network.neutron [req-79bc387e-858a-43c9-9061-cbbb80b51ac9 req-092d0f81-aad4-4306-b6ca-6cdcebfcac37 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-79bc387e-858a-43c9-9061-cbbb80b51ac9 req-092d0f81-aad4-4306-b6ca-6cdcebfcac37 service nova] Releasing lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:28 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:42:28 user nova-compute[72990]: INFO nova.compute.manager [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] instance snapshotting
Aug 27 03:42:28 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Beginning live snapshot process
Aug 27 03:42:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json -f qcow2 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json -f qcow2 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG nova.network.neutron [req-3bd13fd0-5349-4250-aa96-f8a0c44b4b93 req-00d331f3-d6d8-441d-a1fe-1af3e2a960ca service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updated VIF entry in instance network info cache for port eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG nova.network.neutron [req-3bd13fd0-5349-4250-aa96-f8a0c44b4b93 req-00d331f3-d6d8-441d-a1fe-1af3e2a960ca service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3bd13fd0-5349-4250-aa96-f8a0c44b4b93 req-00d331f3-d6d8-441d-a1fe-1af3e2a960ca service nova] Releasing lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-changed-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing instance network info cache due to event network-changed-cbf96d51-1d93-4bcf-9292-fc6eaa08b461. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] Acquiring lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] Acquired lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG nova.network.neutron [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing network info cache for port cbf96d51-1d93-4bcf-9292-fc6eaa08b461 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG nova.network.neutron [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa5m12cf2/f14523895d1a4df9989dc6cc8bfe45de.delta 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa5m12cf2/f14523895d1a4df9989dc6cc8bfe45de.delta 1073741824" returned: 0 in 0.066s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:29 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 03:42:29 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Updating instance_info_cache with network_info: [{"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:42:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-5cdb53ad-4ffa-4a34-9daf-a61801001aa7 req-9ba8c3e5-d635-4016-bdcc-bd1d2008229c service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Received event network-changed-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-5cdb53ad-4ffa-4a34-9daf-a61801001aa7 req-9ba8c3e5-d635-4016-bdcc-bd1d2008229c service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Refreshing instance network info cache due to event network-changed-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5cdb53ad-4ffa-4a34-9daf-a61801001aa7 req-9ba8c3e5-d635-4016-bdcc-bd1d2008229c service nova] Acquiring lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5cdb53ad-4ffa-4a34-9daf-a61801001aa7 req-9ba8c3e5-d635-4016-bdcc-bd1d2008229c service nova] Acquired lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG nova.network.neutron [req-5cdb53ad-4ffa-4a34-9daf-a61801001aa7 req-9ba8c3e5-d635-4016-bdcc-bd1d2008229c service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Refreshing network info cache for port 7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG nova.network.neutron [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] Releasing lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-changed-515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing instance network info cache due to event network-changed-515abaa3-8010-44ee-b397-e0858b8a3d3e. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] Acquiring lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] Acquired lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG nova.network.neutron [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing network info cache for port 515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG nova.network.neutron [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:42:30 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 03:42:30 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:42:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa5m12cf2/f14523895d1a4df9989dc6cc8bfe45de.delta /opt/stack/data/nova/instances/snapshots/tmpa5m12cf2/f14523895d1a4df9989dc6cc8bfe45de {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG nova.network.neutron [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6c15ad31-6233-4276-8aa5-3395d47ac859 req-1277cda3-39c4-4f91-90a9-63f16a63668f service nova] Releasing lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Successfully updated port: 431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-075c3ae4-2f76-448f-8927-d177d0f2db65 req-882b6034-5818-46c4-9a33-0e938023d8e1 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Received event network-changed-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-075c3ae4-2f76-448f-8927-d177d0f2db65 req-882b6034-5818-46c4-9a33-0e938023d8e1 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Refreshing instance network info cache due to event network-changed-11a6b8fd-99ad-43d8-9daa-4594047d1ee8. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-075c3ae4-2f76-448f-8927-d177d0f2db65 req-882b6034-5818-46c4-9a33-0e938023d8e1 service nova] Acquiring lock "refresh_cache-970ca110-30d7-4e41-92d3-aa4e0bda4482" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-075c3ae4-2f76-448f-8927-d177d0f2db65 req-882b6034-5818-46c4-9a33-0e938023d8e1 service nova] Acquired lock "refresh_cache-970ca110-30d7-4e41-92d3-aa4e0bda4482" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG nova.network.neutron [req-075c3ae4-2f76-448f-8927-d177d0f2db65 req-882b6034-5818-46c4-9a33-0e938023d8e1 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Refreshing network info cache for port 11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa5m12cf2/f14523895d1a4df9989dc6cc8bfe45de.delta /opt/stack/data/nova/instances/snapshots/tmpa5m12cf2/f14523895d1a4df9989dc6cc8bfe45de" returned: 0 in 0.339s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:31 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Snapshot extracted, beginning image upload
Aug 27 03:42:31 user nova-compute[72990]: DEBUG nova.network.neutron [req-5cdb53ad-4ffa-4a34-9daf-a61801001aa7 req-9ba8c3e5-d635-4016-bdcc-bd1d2008229c service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updated VIF entry in instance network info cache for port 7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG nova.network.neutron [req-5cdb53ad-4ffa-4a34-9daf-a61801001aa7 req-9ba8c3e5-d635-4016-bdcc-bd1d2008229c service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updating instance_info_cache with network_info: [{"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5cdb53ad-4ffa-4a34-9daf-a61801001aa7 req-9ba8c3e5-d635-4016-bdcc-bd1d2008229c service nova] Releasing lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:42:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-f131b70e-faf1-49ea-acc3-4eb80e5c0e54 req-69e04678-047e-43fd-8256-de83c61372cf service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-changed-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-f131b70e-faf1-49ea-acc3-4eb80e5c0e54 req-69e04678-047e-43fd-8256-de83c61372cf service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing instance network info cache due to event network-changed-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f131b70e-faf1-49ea-acc3-4eb80e5c0e54 req-69e04678-047e-43fd-8256-de83c61372cf service nova] Acquiring lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f131b70e-faf1-49ea-acc3-4eb80e5c0e54 req-69e04678-047e-43fd-8256-de83c61372cf service nova] Acquired lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-f131b70e-faf1-49ea-acc3-4eb80e5c0e54 req-69e04678-047e-43fd-8256-de83c61372cf service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing network info cache for port 431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-075c3ae4-2f76-448f-8927-d177d0f2db65 req-882b6034-5818-46c4-9a33-0e938023d8e1 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Updated VIF entry in instance network info cache for port 11a6b8fd-99ad-43d8-9daa-4594047d1ee8. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:42:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-075c3ae4-2f76-448f-8927-d177d0f2db65 req-882b6034-5818-46c4-9a33-0e938023d8e1 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Updating instance_info_cache with network_info: [{"id": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "address": "fa:16:3e:2f:ee:bb", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6b8fd-99", "ovs_interfaceid": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-075c3ae4-2f76-448f-8927-d177d0f2db65 req-882b6034-5818-46c4-9a33-0e938023d8e1 service nova] Releasing lock "refresh_cache-970ca110-30d7-4e41-92d3-aa4e0bda4482" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-f131b70e-faf1-49ea-acc3-4eb80e5c0e54 req-69e04678-047e-43fd-8256-de83c61372cf service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:42:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-f131b70e-faf1-49ea-acc3-4eb80e5c0e54 req-69e04678-047e-43fd-8256-de83c61372cf service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f131b70e-faf1-49ea-acc3-4eb80e5c0e54 req-69e04678-047e-43fd-8256-de83c61372cf service nova] Releasing lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Successfully updated port: cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:42:33 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Successfully updated port: fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:42:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquired lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:33 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:42:33 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:42:34 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Snapshot image upload complete
Aug 27 03:42:34 user nova-compute[72990]: INFO nova.compute.manager [None req-b240e070-747c-449e-b51b-c9357941809a tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Took 5.77 seconds to snapshot the instance on the hypervisor.
Aug 27 03:42:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-changed-cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing instance network info cache due to event network-changed-cfcfd098-0086-428d-80a8-7c7d408afc3e. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] Acquiring lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:35 user nova-compute[72990]: INFO nova.virt.block_device [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Booting with volume 7f0ef045-45b3-44d6-bd55-a8bd3472abe1 at /dev/vdb
Aug 27 03:42:35 user nova-compute[72990]: DEBUG os_brick.utils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8091b281-5c26-4bbe-a406-b8ad221ab3f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ed48ec-374e-4475-9a02-77c695e4e032]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[18afbab5-4f3e-4495-aaeb-7183625da67b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b5baab-b338-4d1e-8402-d5b24611438f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:42:35 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3beea360-2f10-4335-a1c1-32a31d2f6bf3]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG os_brick.utils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating existing volume attachment record: b9d7de02-4cc4-493a-aef9-7d61ce7d3471 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG nova.objects.instance [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'flavor' on Instance uuid 970ca110-30d7-4e41-92d3-aa4e0bda4482 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.122s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating instance_info_cache with network_info: [{"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "address": "fa:16:3e:3b:1b:87", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd9f8-3d", "ovs_interfaceid": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:35 user nova-compute[72990]: INFO nova.compute.manager [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Attaching volume d4903dc3-968e-4c23-8ea2-a6f69be45ad1 to /dev/vdb
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Releasing lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Instance network_info: |[{"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "address": "fa:16:3e:3b:1b:87", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd9f8-3d", "ovs_interfaceid": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] Acquired lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG nova.network.neutron [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing network info cache for port cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG os_brick.utils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb35b0a4-2aa8-474b-9f13-1c017cd9c477]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d34063-738b-4ce1-bdf8-70aa4d70802b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[12422f65-4708-4464-94c1-eac555c419e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[359647ab-c330-4a45-908a-746899ab9856]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:42:36 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:42:36 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a8f505-7700-4f28-b677-fe8b9c12e95a]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG os_brick.utils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Updating existing volume attachment record: 7ab89b7f-51a4-4cdc-98a5-f97e1eb09341 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG nova.network.neutron [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updated VIF entry in instance network info cache for port cfcfd098-0086-428d-80a8-7c7d408afc3e. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG nova.network.neutron [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating instance_info_cache with network_info: [{"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "address": "fa:16:3e:3b:1b:87", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd9f8-3d", "ovs_interfaceid": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] Releasing lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-changed-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing instance network info cache due to event network-changed-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] Acquiring lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] Acquired lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG nova.network.neutron [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing network info cache for port fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG nova.network.neutron [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updated VIF entry in instance network info cache for port fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG nova.network.neutron [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating instance_info_cache with network_info: [{"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "address": "fa:16:3e:3b:1b:87", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd9f8-3d", "ovs_interfaceid": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-25154816-f423-417e-83ff-f62f7fc8e807 req-5121ea94-4df0-4f9b-8472-3a17786f9721 service nova] Releasing lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-898cb486-b954-490d-ab0c-b504036c774c req-833b20df-a5ee-48dd-967f-1bde0098febb service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Received event network-changed-0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-898cb486-b954-490d-ab0c-b504036c774c req-833b20df-a5ee-48dd-967f-1bde0098febb service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Refreshing instance network info cache due to event network-changed-0ac002a5-64fb-40b4-8da9-22b54f104689. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-898cb486-b954-490d-ab0c-b504036c774c req-833b20df-a5ee-48dd-967f-1bde0098febb service nova] Acquiring lock "refresh_cache-3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-898cb486-b954-490d-ab0c-b504036c774c req-833b20df-a5ee-48dd-967f-1bde0098febb service nova] Acquired lock "refresh_cache-3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG nova.network.neutron [req-898cb486-b954-490d-ab0c-b504036c774c req-833b20df-a5ee-48dd-967f-1bde0098febb service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Refreshing network info cache for port 0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:46 user nova-compute[72990]: INFO nova.virt.block_device [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Booting with volume 1da19fe0-95d1-4eb9-8979-a525393f2690 at /dev/vdc
Aug 27 03:42:46 user nova-compute[72990]: DEBUG nova.network.neutron [req-898cb486-b954-490d-ab0c-b504036c774c req-833b20df-a5ee-48dd-967f-1bde0098febb service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Updated VIF entry in instance network info cache for port 0ac002a5-64fb-40b4-8da9-22b54f104689. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG nova.network.neutron [req-898cb486-b954-490d-ab0c-b504036c774c req-833b20df-a5ee-48dd-967f-1bde0098febb service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Updating instance_info_cache with network_info: [{"id": "0ac002a5-64fb-40b4-8da9-22b54f104689", "address": "fa:16:3e:08:63:16", "network": {"id": "198f33b4-c259-4dea-9f48-11e7d97c8cd4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1964452619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e206c0eeae224e4a985ee0d49c42a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac002a5-64", "ovs_interfaceid": "0ac002a5-64fb-40b4-8da9-22b54f104689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-898cb486-b954-490d-ab0c-b504036c774c req-833b20df-a5ee-48dd-967f-1bde0098febb service nova] Releasing lock "refresh_cache-3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG os_brick.utils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a96ea7-9329-4987-87ac-f99967998c3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[855bdc13-9f39-49db-9b92-23195e7d7287]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c43fc8-bfeb-49de-b57d-2c3f8095bd5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[358be06f-2644-4704-9b33-7d281a621ddb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:42:46 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:42:46 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed15d4c-21f6-4990-b7fd-4543cffacceb]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG os_brick.utils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:42:46 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating existing volume attachment record: 494b0fb3-7351-483d-844f-a4b373d3a74d {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connector [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Factory for ISCSI on None {{(pid=72990) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXLyDgGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:42:47 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:42:47 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:42:47 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9baeb6-a91e-42d2-9dd9-db42ce637684]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:42:47 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5497ac2-7250-4e4a-aad0-b17bf1041c8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1] added
Aug 27 03:42:47 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce20598-af69-4223-8dd6-04234a67e2af]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7679bdbb-244d-4330-865a-47d6c05dec71]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXLyDgGs {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXLyDgGs" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f34508-db28-446d-a8c2-e533628805f3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vXLyDgGs'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92bb8c4-79f4-44ae-8457-46b07b8934ff]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d501e8-3213-4155-a815-b13e05e0d636]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 03:42:47 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 03:42:47 user nova-compute[72990]:  {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:42:47 user nova-compute[72990]: WARNING os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 03:42:47 user nova-compute[72990]: 
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cca0b1-24e6-4d3a-97b7-944b4f7188ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1, portal: 172.16.0.220,3260]
Aug 27 03:42:47 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1, portal: 172.16.0.220,3260] successful.
Aug 27 03:42:47 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2385e86-8c9d-424a-9e8d-e82af9f2ab9a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08d07e0-07b8-49b6-98c3-d5c284c70c15]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:42:47 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:42:47 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ed5154-5753-4729-a693-94fb1d6ca930]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:47 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:42:48 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:42:48 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXLyDgGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:42:48 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:42:48 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23038613365346133', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:42:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038613365346133', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:42:48 user nova-compute[72990]: DEBUG nova.objects.instance [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'flavor' on Instance uuid 970ca110-30d7-4e41-92d3-aa4e0bda4482 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:42:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:42:49 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:42:49 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:42:49 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:42:49 user nova-compute[72990]:   <serial>d4903dc3-968e-4c23-8ea2-a6f69be45ad1</serial>
Aug 27 03:42:49 user nova-compute[72990]: </disk>
Aug 27 03:42:49 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:42:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:42:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:42:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No VIF found with MAC fa:16:3e:2f:ee:bb, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:42:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5ef602c3-9a05-469d-830d-bd8d589fbc13 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.716s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG nova.compute.manager [req-5abd39ec-8c5e-4ddb-a109-64e7eb761751 req-d63120ea-4112-471a-a075-b53c1e2339e6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-changed-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG nova.compute.manager [req-5abd39ec-8c5e-4ddb-a109-64e7eb761751 req-d63120ea-4112-471a-a075-b53c1e2339e6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Refreshing instance network info cache due to event network-changed-48bea006-1d46-416d-8ab6-99617cdbcb63. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5abd39ec-8c5e-4ddb-a109-64e7eb761751 req-d63120ea-4112-471a-a075-b53c1e2339e6 service nova] Acquiring lock "refresh_cache-bc82cced-9f16-44bc-b9bc-622fa99b1be0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5abd39ec-8c5e-4ddb-a109-64e7eb761751 req-d63120ea-4112-471a-a075-b53c1e2339e6 service nova] Acquired lock "refresh_cache-bc82cced-9f16-44bc-b9bc-622fa99b1be0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG nova.network.neutron [req-5abd39ec-8c5e-4ddb-a109-64e7eb761751 req-d63120ea-4112-471a-a075-b53c1e2339e6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Refreshing network info cache for port 48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG nova.objects.instance [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lazy-loading 'flavor' on Instance uuid 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:51 user nova-compute[72990]: INFO nova.compute.manager [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Attaching volume 40c567bf-1384-4153-b228-e69327aa9b93 to /dev/sdc
Aug 27 03:42:51 user nova-compute[72990]: DEBUG os_brick.utils [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[af561dba-cf10-4f84-84b3-3c1fa0e14d56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30f68ba-e182-458b-b4f3-cfca8627e833]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dae7fe-a700-4f31-a6d6-e80a699e3c5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da4d2d2-9da9-4260-afaf-9978c2787eac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:42:51 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:42:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfe4774-03cb-4ad2-9a18-c68b25bb68f9]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG os_brick.utils [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Updating existing volume attachment record: 22756978-2b0a-402a-a333-4f7075067e09 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:42:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:52 user nova-compute[72990]: DEBUG nova.network.neutron [req-5abd39ec-8c5e-4ddb-a109-64e7eb761751 req-d63120ea-4112-471a-a075-b53c1e2339e6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Updated VIF entry in instance network info cache for port 48bea006-1d46-416d-8ab6-99617cdbcb63. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:42:52 user nova-compute[72990]: DEBUG nova.network.neutron [req-5abd39ec-8c5e-4ddb-a109-64e7eb761751 req-d63120ea-4112-471a-a075-b53c1e2339e6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Updating instance_info_cache with network_info: [{"id": "48bea006-1d46-416d-8ab6-99617cdbcb63", "address": "fa:16:3e:b7:4e:53", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bea006-1d", "ovs_interfaceid": "48bea006-1d46-416d-8ab6-99617cdbcb63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5abd39ec-8c5e-4ddb-a109-64e7eb761751 req-d63120ea-4112-471a-a075-b53c1e2339e6 service nova] Releasing lock "refresh_cache-bc82cced-9f16-44bc-b9bc-622fa99b1be0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "e4842b80-80e8-4df9-a4bb-30529de4a013" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:42:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:53 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:42:53 user nova-compute[72990]: INFO nova.compute.claims [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Claim successful on node user
Aug 27 03:42:54 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG nova.network.neutron [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:42:54 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:42:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG nova.policy [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e7d2fc4d4204ad38d0d11376de45bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd007a65dbbce40729d2d7a25561a4f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:42:54 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Creating image(s)
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "/opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "/opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.204s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk 1073741824" returned: 0 in 0.057s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG nova.network.neutron [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Successfully created port: 9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Cannot resize image /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Ensure instance console log exists: /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG nova.objects.instance [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lazy-loading 'flavor' on Instance uuid bc82cced-9f16-44bc-b9bc-622fa99b1be0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG nova.network.neutron [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Successfully updated port: 9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-2cb9befd-9fea-4d60-91a1-ad397362724f req-3227c25b-f106-4930-a58e-fc3df05f944a service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-changed-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-2cb9befd-9fea-4d60-91a1-ad397362724f req-3227c25b-f106-4930-a58e-fc3df05f944a service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Refreshing instance network info cache due to event network-changed-9baf50ad-1b30-457c-a390-d815d4da3ac8. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2cb9befd-9fea-4d60-91a1-ad397362724f req-3227c25b-f106-4930-a58e-fc3df05f944a service nova] Acquiring lock "refresh_cache-e4842b80-80e8-4df9-a4bb-30529de4a013" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2cb9befd-9fea-4d60-91a1-ad397362724f req-3227c25b-f106-4930-a58e-fc3df05f944a service nova] Acquired lock "refresh_cache-e4842b80-80e8-4df9-a4bb-30529de4a013" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG nova.network.neutron [req-2cb9befd-9fea-4d60-91a1-ad397362724f req-3227c25b-f106-4930-a58e-fc3df05f944a service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Refreshing network info cache for port 9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "refresh_cache-e4842b80-80e8-4df9-a4bb-30529de4a013" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.438s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG nova.network.neutron [req-2cb9befd-9fea-4d60-91a1-ad397362724f req-3227c25b-f106-4930-a58e-fc3df05f944a service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:56 user nova-compute[72990]: INFO nova.compute.manager [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Attaching volume 805ebe7f-8866-46e7-92b9-944dfb5c08f5 to /dev/vdb
Aug 27 03:42:56 user nova-compute[72990]: DEBUG os_brick.utils [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG nova.network.neutron [req-2cb9befd-9fea-4d60-91a1-ad397362724f req-3227c25b-f106-4930-a58e-fc3df05f944a service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c981a7fa-f0b7-487f-b675-4ad0f2ef07b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2cb9befd-9fea-4d60-91a1-ad397362724f req-3227c25b-f106-4930-a58e-fc3df05f944a service nova] Releasing lock "refresh_cache-e4842b80-80e8-4df9-a4bb-30529de4a013" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquired lock "refresh_cache-e4842b80-80e8-4df9-a4bb-30529de4a013" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG nova.network.neutron [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[da93c168-73e0-43cb-9ce9-1bcc50301cab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5051c714-b4e4-47da-a947-11aa1993e360]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[425cb035-2094-440d-94c9-add8b3c81dc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG nova.network.neutron [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:42:56 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:42:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3022679-5d67-4dc6-a56f-3e65ed1372bd]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG os_brick.utils [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Updating existing volume attachment record: d17b9126-3568-45de-b701-a39a93c6ea4b {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:42:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.network.neutron [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Updating instance_info_cache with network_info: [{"id": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "address": "fa:16:3e:3f:15:71", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baf50ad-1b", "ovs_interfaceid": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Releasing lock "refresh_cache-e4842b80-80e8-4df9-a4bb-30529de4a013" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Instance network_info: |[{"id": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "address": "fa:16:3e:3f:15:71", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baf50ad-1b", "ovs_interfaceid": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Start _get_guest_xml network_info=[{"id": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "address": "fa:16:3e:3f:15:71", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baf50ad-1b", "ovs_interfaceid": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:42:57 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:42:57 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1289814881',display_name='tempest-AttachVolumeNegativeTest-server-1289814881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1289814881',id=12,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGwPZxxgZ6U5gizU4XbGVi3XvdYVGwnZSHH1e8wPFzu10+6hYJKlyI5B2w+4xeV9SkHAoKXeYHWql29ZjPQqzJjy1I49JygP+c4PdcW7eolOq9gmsh7O7ZioydX5l1dNA==',key_name='tempest-keypair-778008372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d007a65dbbce40729d2d7a25561a4f91',ramdisk_id='',reservation_id='r-la4ew2ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-945598863',owner_user_name='tempest-AttachVolumeNegativeTest-945598863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7d2fc4d4204ad38d0d11376de45bd6',uuid=e4842b80-80e8-4df9-a4bb-30529de4a013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "address": "fa:16:3e:3f:15:71", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baf50ad-1b", "ovs_interfaceid": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converting VIF {"id": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "address": "fa:16:3e:3f:15:71", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baf50ad-1b", "ovs_interfaceid": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:15:71,bridge_name='br-int',has_traffic_filtering=True,id=9baf50ad-1b30-457c-a390-d815d4da3ac8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baf50ad-1b') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.objects.instance [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'pci_devices' on Instance uuid e4842b80-80e8-4df9-a4bb-30529de4a013 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:42:57 user nova-compute[72990]:   <uuid>e4842b80-80e8-4df9-a4bb-30529de4a013</uuid>
Aug 27 03:42:57 user nova-compute[72990]:   <name>instance-0000000c</name>
Aug 27 03:42:57 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:42:57 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:42:57 user nova-compute[72990]:   <metadata>
Aug 27 03:42:57 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:42:57 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:42:57 user nova-compute[72990]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1289814881</nova:name>
Aug 27 03:42:57 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:42:57</nova:creationTime>
Aug 27 03:42:57 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:42:57 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:42:57 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:42:57 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:42:57 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:42:57 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:42:57 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:42:57 user nova-compute[72990]:       <nova:owner>
Aug 27 03:42:57 user nova-compute[72990]:         <nova:user uuid="4e7d2fc4d4204ad38d0d11376de45bd6">tempest-AttachVolumeNegativeTest-945598863-project-member</nova:user>
Aug 27 03:42:57 user nova-compute[72990]:         <nova:project uuid="d007a65dbbce40729d2d7a25561a4f91">tempest-AttachVolumeNegativeTest-945598863</nova:project>
Aug 27 03:42:57 user nova-compute[72990]:       </nova:owner>
Aug 27 03:42:57 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:42:57 user nova-compute[72990]:       <nova:ports>
Aug 27 03:42:57 user nova-compute[72990]:         <nova:port uuid="9baf50ad-1b30-457c-a390-d815d4da3ac8">
Aug 27 03:42:57 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 03:42:57 user nova-compute[72990]:         </nova:port>
Aug 27 03:42:57 user nova-compute[72990]:       </nova:ports>
Aug 27 03:42:57 user nova-compute[72990]:     </nova:instance>
Aug 27 03:42:57 user nova-compute[72990]:   </metadata>
Aug 27 03:42:57 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:42:57 user nova-compute[72990]:     <system>
Aug 27 03:42:57 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:42:57 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:42:57 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:42:57 user nova-compute[72990]:       <entry name="serial">e4842b80-80e8-4df9-a4bb-30529de4a013</entry>
Aug 27 03:42:57 user nova-compute[72990]:       <entry name="uuid">e4842b80-80e8-4df9-a4bb-30529de4a013</entry>
Aug 27 03:42:57 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:42:57 user nova-compute[72990]:     </system>
Aug 27 03:42:57 user nova-compute[72990]:   </sysinfo>
Aug 27 03:42:57 user nova-compute[72990]:   <os>
Aug 27 03:42:57 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:42:57 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:42:57 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:42:57 user nova-compute[72990]:   </os>
Aug 27 03:42:57 user nova-compute[72990]:   <features>
Aug 27 03:42:57 user nova-compute[72990]:     <acpi/>
Aug 27 03:42:57 user nova-compute[72990]:     <apic/>
Aug 27 03:42:57 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:42:57 user nova-compute[72990]:   </features>
Aug 27 03:42:57 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:42:57 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:42:57 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:42:57 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:42:57 user nova-compute[72990]:   </clock>
Aug 27 03:42:57 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:42:57 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:42:57 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:42:57 user nova-compute[72990]:   </cpu>
Aug 27 03:42:57 user nova-compute[72990]:   <devices>
Aug 27 03:42:57 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:42:57 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:42:57 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk"/>
Aug 27 03:42:57 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:42:57 user nova-compute[72990]:     </disk>
Aug 27 03:42:57 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:42:57 user nova-compute[72990]:       <mac address="fa:16:3e:3f:15:71"/>
Aug 27 03:42:57 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:42:57 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:42:57 user nova-compute[72990]:       <target dev="tap9baf50ad-1b"/>
Aug 27 03:42:57 user nova-compute[72990]:     </interface>
Aug 27 03:42:57 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:42:57 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/console.log" append="off"/>
Aug 27 03:42:57 user nova-compute[72990]:     </serial>
Aug 27 03:42:57 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:42:57 user nova-compute[72990]:     <video>
Aug 27 03:42:57 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:42:57 user nova-compute[72990]:     </video>
Aug 27 03:42:57 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:42:57 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:42:57 user nova-compute[72990]:     </rng>
Aug 27 03:42:57 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:42:57 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:42:57 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:42:57 user nova-compute[72990]:     </memballoon>
Aug 27 03:42:57 user nova-compute[72990]:   </devices>
Aug 27 03:42:57 user nova-compute[72990]: </domain>
Aug 27 03:42:57 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1289814881',display_name='tempest-AttachVolumeNegativeTest-server-1289814881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1289814881',id=12,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGwPZxxgZ6U5gizU4XbGVi3XvdYVGwnZSHH1e8wPFzu10+6hYJKlyI5B2w+4xeV9SkHAoKXeYHWql29ZjPQqzJjy1I49JygP+c4PdcW7eolOq9gmsh7O7ZioydX5l1dNA==',key_name='tempest-keypair-778008372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d007a65dbbce40729d2d7a25561a4f91',ramdisk_id='',reservation_id='r-la4ew2ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-945598863',owner_user_name='tempest-AttachVolumeNegativeTest-945598863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7d2fc4d4204ad38d0d11376de45bd6',uuid=e4842b80-80e8-4df9-a4bb-30529de4a013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "address": "fa:16:3e:3f:15:71", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baf50ad-1b", "ovs_interfaceid": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converting VIF {"id": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "address": "fa:16:3e:3f:15:71", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baf50ad-1b", "ovs_interfaceid": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:15:71,bridge_name='br-int',has_traffic_filtering=True,id=9baf50ad-1b30-457c-a390-d815d4da3ac8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baf50ad-1b') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG os_vif [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:15:71,bridge_name='br-int',has_traffic_filtering=True,id=9baf50ad-1b30-457c-a390-d815d4da3ac8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baf50ad-1b') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9baf50ad-1b, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9baf50ad-1b, col_values=(('external_ids', {'iface-id': '9baf50ad-1b30-457c-a390-d815d4da3ac8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:15:71', 'vm-uuid': 'e4842b80-80e8-4df9-a4bb-30529de4a013'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:57 user nova-compute[72990]: INFO os_vif [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:15:71,bridge_name='br-int',has_traffic_filtering=True,id=9baf50ad-1b30-457c-a390-d815d4da3ac8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baf50ad-1b')
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:42:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No VIF found with MAC fa:16:3e:3f:15:71, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:42:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:58 user nova-compute[72990]: DEBUG nova.compute.manager [req-7f4121e7-627e-41e1-978d-9ac606703122 req-04ad4ccb-21b1-4934-b6b3-76f8689e0426 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:42:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7f4121e7-627e-41e1-978d-9ac606703122 req-04ad4ccb-21b1-4934-b6b3-76f8689e0426 service nova] Acquiring lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7f4121e7-627e-41e1-978d-9ac606703122 req-04ad4ccb-21b1-4934-b6b3-76f8689e0426 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7f4121e7-627e-41e1-978d-9ac606703122 req-04ad4ccb-21b1-4934-b6b3-76f8689e0426 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:58 user nova-compute[72990]: DEBUG nova.compute.manager [req-7f4121e7-627e-41e1-978d-9ac606703122 req-04ad4ccb-21b1-4934-b6b3-76f8689e0426 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] No waiting events found dispatching network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:42:58 user nova-compute[72990]: WARNING nova.compute.manager [req-7f4121e7-627e-41e1-978d-9ac606703122 req-04ad4ccb-21b1-4934-b6b3-76f8689e0426 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received unexpected event network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 for instance with vm_state building and task_state spawning.
Aug 27 03:42:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:42:59 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Creating image(s)
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Ensure instance console log exists: /opt/stack/data/nova/instances/bbab26b4-9515-4427-a01c-04f4a85b1fa8/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Start _get_guest_xml network_info=[{"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "address": "fa:16:3e:3b:1b:87", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd9f8-3d", "ovs_interfaceid": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '5ddcf7a8-b004-4cf0-82be-6b281c7c0911', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJSOvjAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bbab26b4-9515-4427-a01c-04f4a85b1fa8', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3c79c6f-3849-465f-9826-78c35675890c', 'serial': 'd3c79c6f-3849-465f-9826-78c35675890c'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'b9d7de02-4cc4-493a-aef9-7d61ce7d3471', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXydBzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bbab26b4-9515-4427-a01c-04f4a85b1fa8', 'attached_at': '', 'detached_at': '', 'volume_id': '7f0ef045-45b3-44d6-bd55-a8bd3472abe1', 'serial': '7f0ef045-45b3-44d6-bd55-a8bd3472abe1'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '494b0fb3-7351-483d-844f-a4b373d3a74d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlkpVyoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bbab26b4-9515-4427-a01c-04f4a85b1fa8', 'attached_at': '', 'detached_at': '', 'volume_id': '1da19fe0-95d1-4eb9-8979-a525393f2690', 'serial': '1da19fe0-95d1-4eb9-8979-a525393f2690'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:42:59 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:42:59 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJSOvjAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:42:59 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:42:59 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:42:59 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f46c1b1-0647-490e-bd0e-a13f60975217]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:42:59 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c749f24b-b0e5-4c99-b51b-9bdd19682619]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c] added
Aug 27 03:42:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34aaa04-f66b-4b2a-9593-d06300f2a6e3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64192d4-6c49-465a-b161-6a648d312530]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BJSOvjAb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BJSOvjAb" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[738568ae-f3b5-4a16-bdd6-d81bbd977927]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BJSOvjAb'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaee0a0-5444-48b9-9e7b-7ebcec7dd48b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae10499f-eb72-4d05-8cb5-69daf7cee689]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:42:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:42:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bc7dc5-9117-410f-807c-82e45f9f0449]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c, portal: 172.16.0.220,3260]
Aug 27 03:42:59 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c, portal: 172.16.0.220,3260] successful.
Aug 27 03:42:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f6a94e-9150-46e9-a5fd-c8fdb4040b4e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa878ff-c95f-45c8-824d-0ac42e041c5c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:42:59 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:42:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:42:59 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:42:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b8821f-9802-469a-bb79-fac224d8cedc]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:42:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-fa7289c8-214f-446f-aafa-e4c826b9e635 req-321c973d-5dab-40a3-a9d3-8024a15b331d service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Received event network-changed-201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-fa7289c8-214f-446f-aafa-e4c826b9e635 req-321c973d-5dab-40a3-a9d3-8024a15b331d service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Refreshing instance network info cache due to event network-changed-201b57cf-6d21-45f8-8b60-0aa05a6c24af. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fa7289c8-214f-446f-aafa-e4c826b9e635 req-321c973d-5dab-40a3-a9d3-8024a15b331d service nova] Acquiring lock "refresh_cache-a388d657-a11d-4a63-b7fc-2df799ca72d0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fa7289c8-214f-446f-aafa-e4c826b9e635 req-321c973d-5dab-40a3-a9d3-8024a15b331d service nova] Acquired lock "refresh_cache-a388d657-a11d-4a63-b7fc-2df799ca72d0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.network.neutron [req-fa7289c8-214f-446f-aafa-e4c826b9e635 req-321c973d-5dab-40a3-a9d3-8024a15b331d service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Refreshing network info cache for port 201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.objects.instance [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lazy-loading 'flavor' on Instance uuid a388d657-a11d-4a63-b7fc-2df799ca72d0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-63fb1f15-187a-422e-ac11-2063af0cdef3 req-a9f09ca5-ceba-4235-afa5-4bcc82ce5220 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63fb1f15-187a-422e-ac11-2063af0cdef3 req-a9f09ca5-ceba-4235-afa5-4bcc82ce5220 service nova] Acquiring lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63fb1f15-187a-422e-ac11-2063af0cdef3 req-a9f09ca5-ceba-4235-afa5-4bcc82ce5220 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63fb1f15-187a-422e-ac11-2063af0cdef3 req-a9f09ca5-ceba-4235-afa5-4bcc82ce5220 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-63fb1f15-187a-422e-ac11-2063af0cdef3 req-a9f09ca5-ceba-4235-afa5-4bcc82ce5220 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] No waiting events found dispatching network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:00 user nova-compute[72990]: WARNING nova.compute.manager [req-63fb1f15-187a-422e-ac11-2063af0cdef3 req-a9f09ca5-ceba-4235-afa5-4bcc82ce5220 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received unexpected event network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 for instance with vm_state building and task_state spawning.
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:00 user nova-compute[72990]: INFO nova.compute.manager [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Attaching volume 8e14715b-7629-40da-89fb-5982d92f42b7 to /dev/vdb
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107780.8704388, e4842b80-80e8-4df9-a4bb-30529de4a013 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:43:00 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] VM Resumed (Lifecycle Event)
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:43:00 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Instance spawned successfully.
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG os_brick.utils [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.network.neutron [req-fa7289c8-214f-446f-aafa-e4c826b9e635 req-321c973d-5dab-40a3-a9d3-8024a15b331d service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Updated VIF entry in instance network info cache for port 201b57cf-6d21-45f8-8b60-0aa05a6c24af. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.network.neutron [req-fa7289c8-214f-446f-aafa-e4c826b9e635 req-321c973d-5dab-40a3-a9d3-8024a15b331d service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Updating instance_info_cache with network_info: [{"id": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "address": "fa:16:3e:1d:b5:ae", "network": {"id": "7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-491390485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef7bf02a47b04791acfb0c2ef68f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201b57cf-6d", "ovs_interfaceid": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b90719-c322-4cad-b5b1-6d8a1e8765b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fa7289c8-214f-446f-aafa-e4c826b9e635 req-321c973d-5dab-40a3-a9d3-8024a15b331d service nova] Releasing lock "refresh_cache-a388d657-a11d-4a63-b7fc-2df799ca72d0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:00 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107780.8766515, e4842b80-80e8-4df9-a4bb-30529de4a013 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:43:00 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] VM Started (Lifecycle Event)
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c7f90e-1723-4c61-9d4d-933e441062c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJSOvjAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23166396331643733', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166396331643733', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faa6d95-d870-43f7-b2aa-d7e62d907996]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff6b35a-4510-4432-9bff-473bfbf4828b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:43:01 user nova-compute[72990]: INFO nova.compute.manager [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Took 6.57 seconds to spawn the instance on the hypervisor.
Aug 27 03:43:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:43:01 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac01675-113f-4d4d-91af-b7b290ddfadc]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.utils [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Updating existing volume attachment record: 48dbd492-f876-4e6e-a1eb-11db6714caa6 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXydBzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:01 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:01 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:01 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a989bb31-a71a-47ba-940d-1570973b4a34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:43:01 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c6cc7c-f978-4281-8965-7c005214e911]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1] added
Aug 27 03:43:01 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: INFO nova.compute.manager [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Took 7.42 seconds to build instance.
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f6e883-525a-4953-ab7e-f60134d31daa]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cbdc79df-2097-4b18-8b76-ca1aa14fa13a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.537s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36332bc-0957-4599-81f7-18fa4522c9b5]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcXydBzE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcXydBzE" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[417d8326-4dda-40f8-ba66-4964e331f4ca]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcXydBzE'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf07840-cbe8-4462-bf1c-fa37d6a53a38]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d834ad-6f10-4daf-9781-d9b8b7363421]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:01 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:01 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:01 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:01 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c161138c-a69e-434c-bcdb-a326919ac80e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1, portal: 172.16.0.220,3260]
Aug 27 03:43:01 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:01 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d288d14-c983-4ba7-8fc6-4db03008b6d6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd88abc4-8627-48c0-9745-515af11be02f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:01 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:01 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:01 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:01 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:01 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:01 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86fbde5-b487-4dbe-a245-85933aeccac8]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXydBzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:43:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26461356636353563', 'path': '/dev/sdd'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461356636353563', 'path': '/dev/sdd'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlkpVyoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:02 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:02 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:02 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32b0b39-3cb3-4f63-a3f7-1d18e1c56e8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:43:02 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[870b28c7-865a-4957-907d-e6c980a15f4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690] added
Aug 27 03:43:02 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8c9633-ea35-456c-aab6-5b15d96b3411]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[948894cf-8e61-4d66-8435-1a8db684e8dc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qlkpVyoC {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qlkpVyoC" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7813dff7-291f-4884-a9ba-cdf131aac2d5]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qlkpVyoC'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8ef288-22de-49d7-9823-0e136a4cae58]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f48a11f-2fba-44fa-94c5-b5206a65f156]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:02 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:02 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:02 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:02 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:02 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:02 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9e1dc3-211d-4de0-ac26-380e5d3deac2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690, portal: 172.16.0.220,3260]
Aug 27 03:43:02 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:02 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0014e2-13ee-4fdb-88d2-9d2e625f4ad6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8bc1c2-6df5-4d8f-af43-7c75e61ca190]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:02 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:02 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:02 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:02 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:02 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:02 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:02 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:02 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea74a16-1519-4c43-84f2-c4e01d119356]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:02 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlkpVyoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26432653039663731', 'path': '/dev/sde'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432653039663731', 'path': '/dev/sde'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d1:99,bridge_name='br-int',has_traffic_filtering=True,id=37ba863e-2224-43c9-8b0e-76d42e1ec9ac,network=Network(313da542-8e92-4faa-92ed-8d52cd21e2f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ba863e-22') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=3317df18-83e4-4bba-9edb-ca6db2cc4295,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3317df18-83') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:10:95,bridge_name='br-int',has_traffic_filtering=True,id=cbf96d51-1d93-4bcf-9292-fc6eaa08b461,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbf96d51-1d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:b3,bridge_name='br-int',has_traffic_filtering=True,id=515abaa3-8010-44ee-b397-e0858b8a3d3e,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515abaa3-80') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "address": "fa:16:3e:3b:1b:87", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd9f8-3d", "ovs_interfaceid": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "address": "fa:16:3e:3b:1b:87", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd9f8-3d", "ovs_interfaceid": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=431bd9f8-3d84-4fd2-a62b-36fc4d7b557f,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd9f8-3d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1b:f8,bridge_name='br-int',has_traffic_filtering=True,id=cfcfd098-0086-428d-80a8-7c7d408afc3e,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfcfd098-00') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a8:03,bridge_name='br-int',has_traffic_filtering=True,id=fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd45192c-db') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.objects.instance [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lazy-loading 'pci_devices' on Instance uuid bbab26b4-9515-4427-a01c-04f4a85b1fa8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:43:03 user nova-compute[72990]:   <uuid>bbab26b4-9515-4427-a01c-04f4a85b1fa8</uuid>
Aug 27 03:43:03 user nova-compute[72990]:   <name>instance-0000000b</name>
Aug 27 03:43:03 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:43:03 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:43:03 user nova-compute[72990]:   <metadata>
Aug 27 03:43:03 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:43:03 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:43:03 user nova-compute[72990]:       <nova:name>tempest-device-tagging-server-1624093023</nova:name>
Aug 27 03:43:03 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:42:59</nova:creationTime>
Aug 27 03:43:03 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:43:03 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:43:03 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:43:03 user nova-compute[72990]:       <nova:owner>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:user uuid="295b1d8849c64318b96d69a4ce248a9c">tempest-TaggedBootDevicesTest_v242-138235642-project-member</nova:user>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:project uuid="185df0487c2245a5a764f2006dec8341">tempest-TaggedBootDevicesTest_v242-138235642</nova:project>
Aug 27 03:43:03 user nova-compute[72990]:       </nova:owner>
Aug 27 03:43:03 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:43:03 user nova-compute[72990]:       <nova:ports>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:port uuid="37ba863e-2224-43c9-8b0e-76d42e1ec9ac">
Aug 27 03:43:03 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 03:43:03 user nova-compute[72990]:         </nova:port>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:port uuid="3317df18-83e4-4bba-9edb-ca6db2cc4295">
Aug 27 03:43:03 user nova-compute[72990]:           <nova:ip type="fixed" address="10.1.1.68" ipVersion="4"/>
Aug 27 03:43:03 user nova-compute[72990]:         </nova:port>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:port uuid="cbf96d51-1d93-4bcf-9292-fc6eaa08b461">
Aug 27 03:43:03 user nova-compute[72990]:           <nova:ip type="fixed" address="10.1.1.131" ipVersion="4"/>
Aug 27 03:43:03 user nova-compute[72990]:         </nova:port>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:port uuid="515abaa3-8010-44ee-b397-e0858b8a3d3e">
Aug 27 03:43:03 user nova-compute[72990]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Aug 27 03:43:03 user nova-compute[72990]:         </nova:port>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:port uuid="431bd9f8-3d84-4fd2-a62b-36fc4d7b557f">
Aug 27 03:43:03 user nova-compute[72990]:           <nova:ip type="fixed" address="10.1.1.168" ipVersion="4"/>
Aug 27 03:43:03 user nova-compute[72990]:         </nova:port>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:port uuid="cfcfd098-0086-428d-80a8-7c7d408afc3e">
Aug 27 03:43:03 user nova-compute[72990]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 27 03:43:03 user nova-compute[72990]:         </nova:port>
Aug 27 03:43:03 user nova-compute[72990]:         <nova:port uuid="fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c">
Aug 27 03:43:03 user nova-compute[72990]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 27 03:43:03 user nova-compute[72990]:         </nova:port>
Aug 27 03:43:03 user nova-compute[72990]:       </nova:ports>
Aug 27 03:43:03 user nova-compute[72990]:     </nova:instance>
Aug 27 03:43:03 user nova-compute[72990]:   </metadata>
Aug 27 03:43:03 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:43:03 user nova-compute[72990]:     <system>
Aug 27 03:43:03 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:43:03 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:43:03 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:43:03 user nova-compute[72990]:       <entry name="serial">bbab26b4-9515-4427-a01c-04f4a85b1fa8</entry>
Aug 27 03:43:03 user nova-compute[72990]:       <entry name="uuid">bbab26b4-9515-4427-a01c-04f4a85b1fa8</entry>
Aug 27 03:43:03 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:43:03 user nova-compute[72990]:     </system>
Aug 27 03:43:03 user nova-compute[72990]:   </sysinfo>
Aug 27 03:43:03 user nova-compute[72990]:   <os>
Aug 27 03:43:03 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:43:03 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:43:03 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:43:03 user nova-compute[72990]:   </os>
Aug 27 03:43:03 user nova-compute[72990]:   <features>
Aug 27 03:43:03 user nova-compute[72990]:     <acpi/>
Aug 27 03:43:03 user nova-compute[72990]:     <apic/>
Aug 27 03:43:03 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:43:03 user nova-compute[72990]:   </features>
Aug 27 03:43:03 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:43:03 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:43:03 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:43:03 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:43:03 user nova-compute[72990]:   </clock>
Aug 27 03:43:03 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:43:03 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:43:03 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:43:03 user nova-compute[72990]:   </cpu>
Aug 27 03:43:03 user nova-compute[72990]:   <devices>
Aug 27 03:43:03 user nova-compute[72990]:     <disk type="file" device="cdrom">
Aug 27 03:43:03 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 03:43:03 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/bbab26b4-9515-4427-a01c-04f4a85b1fa8/disk.config"/>
Aug 27 03:43:03 user nova-compute[72990]:       <target dev="hda" bus="ide"/>
Aug 27 03:43:03 user nova-compute[72990]:     </disk>
Aug 27 03:43:03 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:43:03 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:03 user nova-compute[72990]:       <source dev="/dev/sdc"/>
Aug 27 03:43:03 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:43:03 user nova-compute[72990]:       <serial>d3c79c6f-3849-465f-9826-78c35675890c</serial>
Aug 27 03:43:03 user nova-compute[72990]:     </disk>
Aug 27 03:43:03 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:43:03 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:03 user nova-compute[72990]:       <source dev="/dev/sdd"/>
Aug 27 03:43:03 user nova-compute[72990]:       <target dev="vdb" bus="virtio"/>
Aug 27 03:43:03 user nova-compute[72990]:       <serial>7f0ef045-45b3-44d6-bd55-a8bd3472abe1</serial>
Aug 27 03:43:03 user nova-compute[72990]:     </disk>
Aug 27 03:43:03 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:43:03 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:03 user nova-compute[72990]:       <source dev="/dev/sde"/>
Aug 27 03:43:03 user nova-compute[72990]:       <target dev="vdc" bus="virtio"/>
Aug 27 03:43:03 user nova-compute[72990]:       <serial>1da19fe0-95d1-4eb9-8979-a525393f2690</serial>
Aug 27 03:43:03 user nova-compute[72990]:     </disk>
Aug 27 03:43:03 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:43:03 user nova-compute[72990]:       <mac address="fa:16:3e:53:d1:99"/>
Aug 27 03:43:03 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:43:03 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:43:03 user nova-compute[72990]:       <target dev="tap37ba863e-22"/>
Aug 27 03:43:03 user nova-compute[72990]:     </interface>
Aug 27 03:43:03 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:43:03 user nova-compute[72990]:       <mac address="fa:16:3e:9a:1a:4f"/>
Aug 27 03:43:03 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:43:03 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:43:03 user nova-compute[72990]:       <target dev="tap3317df18-83"/>
Aug 27 03:43:03 user nova-compute[72990]:     </interface>
Aug 27 03:43:03 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:43:03 user nova-compute[72990]:       <mac address="fa:16:3e:cf:10:95"/>
Aug 27 03:43:03 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:43:03 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:43:03 user nova-compute[72990]:       <target dev="tapcbf96d51-1d"/>
Aug 27 03:43:03 user nova-compute[72990]:     </interface>
Aug 27 03:43:03 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:43:03 user nova-compute[72990]:       <mac address="fa:16:3e:02:9d:b3"/>
Aug 27 03:43:03 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:43:03 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:43:03 user nova-compute[72990]:       <target dev="tap515abaa3-80"/>
Aug 27 03:43:03 user nova-compute[72990]:     </interface>
Aug 27 03:43:03 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:43:03 user nova-compute[72990]:       <mac address="fa:16:3e:3b:1b:87"/>
Aug 27 03:43:03 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:43:03 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:43:03 user nova-compute[72990]:       <target dev="tap431bd9f8-3d"/>
Aug 27 03:43:03 user nova-compute[72990]:     </interface>
Aug 27 03:43:03 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:43:03 user nova-compute[72990]:       <mac address="fa:16:3e:9a:1b:f8"/>
Aug 27 03:43:03 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:43:03 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:43:03 user nova-compute[72990]:       <target dev="tapcfcfd098-00"/>
Aug 27 03:43:03 user nova-compute[72990]:     </interface>
Aug 27 03:43:03 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:43:03 user nova-compute[72990]:       <mac address="fa:16:3e:f1:a8:03"/>
Aug 27 03:43:03 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:43:03 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:43:03 user nova-compute[72990]:       <target dev="tapfd45192c-db"/>
Aug 27 03:43:03 user nova-compute[72990]:     </interface>
Aug 27 03:43:03 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:43:03 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/bbab26b4-9515-4427-a01c-04f4a85b1fa8/console.log" append="off"/>
Aug 27 03:43:03 user nova-compute[72990]:     </serial>
Aug 27 03:43:03 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:43:03 user nova-compute[72990]:     <video>
Aug 27 03:43:03 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:43:03 user nova-compute[72990]:     </video>
Aug 27 03:43:03 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:43:03 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:43:03 user nova-compute[72990]:     </rng>
Aug 27 03:43:03 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:43:03 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:43:03 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:43:03 user nova-compute[72990]:     </memballoon>
Aug 27 03:43:03 user nova-compute[72990]:   </devices>
Aug 27 03:43:03 user nova-compute[72990]: </domain>
Aug 27 03:43:03 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d1:99,bridge_name='br-int',has_traffic_filtering=True,id=37ba863e-2224-43c9-8b0e-76d42e1ec9ac,network=Network(313da542-8e92-4faa-92ed-8d52cd21e2f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ba863e-22') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d1:99,bridge_name='br-int',has_traffic_filtering=True,id=37ba863e-2224-43c9-8b0e-76d42e1ec9ac,network=Network(313da542-8e92-4faa-92ed-8d52cd21e2f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ba863e-22') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37ba863e-22, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37ba863e-22, col_values=(('external_ids', {'iface-id': '37ba863e-2224-43c9-8b0e-76d42e1ec9ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:d1:99', 'vm-uuid': 'bbab26b4-9515-4427-a01c-04f4a85b1fa8'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:03 user nova-compute[72990]: INFO os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d1:99,bridge_name='br-int',has_traffic_filtering=True,id=37ba863e-2224-43c9-8b0e-76d42e1ec9ac,network=Network(313da542-8e92-4faa-92ed-8d52cd21e2f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ba863e-22')
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=3317df18-83e4-4bba-9edb-ca6db2cc4295,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3317df18-83') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=3317df18-83e4-4bba-9edb-ca6db2cc4295,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3317df18-83') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3317df18-83, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3317df18-83, col_values=(('external_ids', {'iface-id': '3317df18-83e4-4bba-9edb-ca6db2cc4295', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:1a:4f', 'vm-uuid': 'bbab26b4-9515-4427-a01c-04f4a85b1fa8'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: INFO os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=3317df18-83e4-4bba-9edb-ca6db2cc4295,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3317df18-83')
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:10:95,bridge_name='br-int',has_traffic_filtering=True,id=cbf96d51-1d93-4bcf-9292-fc6eaa08b461,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbf96d51-1d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:10:95,bridge_name='br-int',has_traffic_filtering=True,id=cbf96d51-1d93-4bcf-9292-fc6eaa08b461,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbf96d51-1d') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbf96d51-1d, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcbf96d51-1d, col_values=(('external_ids', {'iface-id': 'cbf96d51-1d93-4bcf-9292-fc6eaa08b461', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:10:95', 'vm-uuid': 'bbab26b4-9515-4427-a01c-04f4a85b1fa8'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: INFO os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:10:95,bridge_name='br-int',has_traffic_filtering=True,id=cbf96d51-1d93-4bcf-9292-fc6eaa08b461,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbf96d51-1d')
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:b3,bridge_name='br-int',has_traffic_filtering=True,id=515abaa3-8010-44ee-b397-e0858b8a3d3e,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515abaa3-80') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:b3,bridge_name='br-int',has_traffic_filtering=True,id=515abaa3-8010-44ee-b397-e0858b8a3d3e,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515abaa3-80') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap515abaa3-80, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap515abaa3-80, col_values=(('external_ids', {'iface-id': '515abaa3-8010-44ee-b397-e0858b8a3d3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:9d:b3', 'vm-uuid': 'bbab26b4-9515-4427-a01c-04f4a85b1fa8'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: INFO os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:b3,bridge_name='br-int',has_traffic_filtering=True,id=515abaa3-8010-44ee-b397-e0858b8a3d3e,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515abaa3-80')
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "address": "fa:16:3e:3b:1b:87", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd9f8-3d", "ovs_interfaceid": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "address": "fa:16:3e:3b:1b:87", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd9f8-3d", "ovs_interfaceid": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=431bd9f8-3d84-4fd2-a62b-36fc4d7b557f,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd9f8-3d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=431bd9f8-3d84-4fd2-a62b-36fc4d7b557f,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd9f8-3d') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap431bd9f8-3d, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap431bd9f8-3d, col_values=(('external_ids', {'iface-id': '431bd9f8-3d84-4fd2-a62b-36fc4d7b557f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:1b:87', 'vm-uuid': 'bbab26b4-9515-4427-a01c-04f4a85b1fa8'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: INFO os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=431bd9f8-3d84-4fd2-a62b-36fc4d7b557f,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd9f8-3d')
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1b:f8,bridge_name='br-int',has_traffic_filtering=True,id=cfcfd098-0086-428d-80a8-7c7d408afc3e,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfcfd098-00') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1b:f8,bridge_name='br-int',has_traffic_filtering=True,id=cfcfd098-0086-428d-80a8-7c7d408afc3e,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfcfd098-00') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfcfd098-00, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcfcfd098-00, col_values=(('external_ids', {'iface-id': 'cfcfd098-0086-428d-80a8-7c7d408afc3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:1b:f8', 'vm-uuid': 'bbab26b4-9515-4427-a01c-04f4a85b1fa8'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: INFO os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1b:f8,bridge_name='br-int',has_traffic_filtering=True,id=cfcfd098-0086-428d-80a8-7c7d408afc3e,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfcfd098-00')
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a8:03,bridge_name='br-int',has_traffic_filtering=True,id=fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd45192c-db') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a8:03,bridge_name='br-int',has_traffic_filtering=True,id=fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd45192c-db') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd45192c-db, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd45192c-db, col_values=(('external_ids', {'iface-id': 'fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:a8:03', 'vm-uuid': 'bbab26b4-9515-4427-a01c-04f4a85b1fa8'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:04 user nova-compute[72990]: INFO os_vif [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a8:03,bridge_name='br-int',has_traffic_filtering=True,id=fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd45192c-db')
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] No BDM found with device name hda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] No VIF found with MAC fa:16:3e:53:d1:99, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] No VIF found with MAC fa:16:3e:3b:1b:87, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:43:04 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Using config drive
Aug 27 03:43:04 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Creating config drive at /opt/stack/data/nova/instances/bbab26b4-9515-4427-a01c-04f4a85b1fa8/disk.config
Aug 27 03:43:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bbab26b4-9515-4427-a01c-04f4a85b1fa8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9nmjpprn {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bbab26b4-9515-4427-a01c-04f4a85b1fa8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9nmjpprn" returned: 0 in 0.088s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwLCtzWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:05 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:05 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:05 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2ee08a-6f22-4caf-acfc-85f17a8fd352]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:43:05 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a697a356-2728-4f3f-8405-aae23e61d24d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93] added
Aug 27 03:43:05 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[954ce299-6a39-41f2-818c-9338cf21be06]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[363999ac-5834-4891-ae9f-ff3b7c21f6ce]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwLCtzWJ {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwLCtzWJ" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5489c4de-8812-42bf-9916-b13f309dce02]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VwLCtzWJ'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f390eea-4c20-41ab-9699-212e3ebb6123]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1c6ac0-807c-4b4c-b4a4-5c6a2fe05ac3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[261c9333-8e92-4325-a2c6-9ebc2c730966]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93, portal: 172.16.0.220,3260]
Aug 27 03:43:05 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:05 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[410a9d6f-25ed-439d-bfc5-0514500b53bb]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[52effec7-fe33-4634-908b-62ac583dd9b5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 (non-flash)
Aug 27 03:43:05 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1152c7df-80c3-492e-97d4-1a2c849b2482]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:05 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwLCtzWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:43:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '26636613536663164', 'path': '/dev/sdf'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636613536663164', 'path': '/dev/sdf'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:43:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:06 user nova-compute[72990]: DEBUG nova.objects.instance [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lazy-loading 'flavor' on Instance uuid 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:43:06 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:06 user nova-compute[72990]:   <source dev="/dev/sdf"/>
Aug 27 03:43:06 user nova-compute[72990]:   <target dev="sdc" bus="scsi"/>
Aug 27 03:43:06 user nova-compute[72990]:   <serial>40c567bf-1384-4153-b228-e69327aa9b93</serial>
Aug 27 03:43:06 user nova-compute[72990]:   <address type="drive" controller="0" unit="2"/>
Aug 27 03:43:06 user nova-compute[72990]: </disk>
Aug 27 03:43:06 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:43:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-5dc6fbfb-cdeb-4760-8291-cedeabbb10a5 req-f46b4481-5ff1-43fc-9970-61dfc649bd6e service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5dc6fbfb-cdeb-4760-8291-cedeabbb10a5 req-f46b4481-5ff1-43fc-9970-61dfc649bd6e service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5dc6fbfb-cdeb-4760-8291-cedeabbb10a5 req-f46b4481-5ff1-43fc-9970-61dfc649bd6e service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5dc6fbfb-cdeb-4760-8291-cedeabbb10a5 req-f46b4481-5ff1-43fc-9970-61dfc649bd6e service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-5dc6fbfb-cdeb-4760-8291-cedeabbb10a5 req-f46b4481-5ff1-43fc-9970-61dfc649bd6e service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:07 user nova-compute[72990]: WARNING nova.compute.manager [req-5dc6fbfb-cdeb-4760-8291-cedeabbb10a5 req-f46b4481-5ff1-43fc-9970-61dfc649bd6e service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-37ba863e-2224-43c9-8b0e-76d42e1ec9ac for instance with vm_state building and task_state spawning.
Aug 27 03:43:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] No BDM found with device name sda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] No VIF found with MAC fa:16:3e:08:63:16, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-bdffe7fc-5449-4fa0-8813-99e728ddced0 req-3b332a62-7eb3-4afd-8499-aad5ede7230b service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-3317df18-83e4-4bba-9edb-ca6db2cc4295 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bdffe7fc-5449-4fa0-8813-99e728ddced0 req-3b332a62-7eb3-4afd-8499-aad5ede7230b service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bdffe7fc-5449-4fa0-8813-99e728ddced0 req-3b332a62-7eb3-4afd-8499-aad5ede7230b service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bdffe7fc-5449-4fa0-8813-99e728ddced0 req-3b332a62-7eb3-4afd-8499-aad5ede7230b service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-bdffe7fc-5449-4fa0-8813-99e728ddced0 req-3b332a62-7eb3-4afd-8499-aad5ede7230b service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-3317df18-83e4-4bba-9edb-ca6db2cc4295 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:07 user nova-compute[72990]: WARNING nova.compute.manager [req-bdffe7fc-5449-4fa0-8813-99e728ddced0 req-3b332a62-7eb3-4afd-8499-aad5ede7230b service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-3317df18-83e4-4bba-9edb-ca6db2cc4295 for instance with vm_state building and task_state spawning.
Aug 27 03:43:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b89ea17e-ba0c-46db-8d5e-30997eb3a816 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.507s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-1f718169-68d5-4eea-bed4-bf5a73bf63da req-e4d671ad-d7b6-42df-94ca-67ad4d2beca4 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1f718169-68d5-4eea-bed4-bf5a73bf63da req-e4d671ad-d7b6-42df-94ca-67ad4d2beca4 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1f718169-68d5-4eea-bed4-bf5a73bf63da req-e4d671ad-d7b6-42df-94ca-67ad4d2beca4 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1f718169-68d5-4eea-bed4-bf5a73bf63da req-e4d671ad-d7b6-42df-94ca-67ad4d2beca4 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-1f718169-68d5-4eea-bed4-bf5a73bf63da req-e4d671ad-d7b6-42df-94ca-67ad4d2beca4 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:08 user nova-compute[72990]: WARNING nova.compute.manager [req-1f718169-68d5-4eea-bed4-bf5a73bf63da req-e4d671ad-d7b6-42df-94ca-67ad4d2beca4 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 for instance with vm_state building and task_state spawning.
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f8be6030-d94b-4f7d-a740-bf4d70cc173d req-1b55bd66-1289-4140-8be0-e98627d174da service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f8be6030-d94b-4f7d-a740-bf4d70cc173d req-1b55bd66-1289-4140-8be0-e98627d174da service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f8be6030-d94b-4f7d-a740-bf4d70cc173d req-1b55bd66-1289-4140-8be0-e98627d174da service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f8be6030-d94b-4f7d-a740-bf4d70cc173d req-1b55bd66-1289-4140-8be0-e98627d174da service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f8be6030-d94b-4f7d-a740-bf4d70cc173d req-1b55bd66-1289-4140-8be0-e98627d174da service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:09 user nova-compute[72990]: WARNING nova.compute.manager [req-f8be6030-d94b-4f7d-a740-bf4d70cc173d req-1b55bd66-1289-4140-8be0-e98627d174da service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-37ba863e-2224-43c9-8b0e-76d42e1ec9ac for instance with vm_state building and task_state spawning.
Aug 27 03:43:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f8be6030-d94b-4f7d-a740-bf4d70cc173d req-1b55bd66-1289-4140-8be0-e98627d174da service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f8be6030-d94b-4f7d-a740-bf4d70cc173d req-1b55bd66-1289-4140-8be0-e98627d174da service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f8be6030-d94b-4f7d-a740-bf4d70cc173d req-1b55bd66-1289-4140-8be0-e98627d174da service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f8be6030-d94b-4f7d-a740-bf4d70cc173d req-1b55bd66-1289-4140-8be0-e98627d174da service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f8be6030-d94b-4f7d-a740-bf4d70cc173d req-1b55bd66-1289-4140-8be0-e98627d174da service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:09 user nova-compute[72990]: WARNING nova.compute.manager [req-f8be6030-d94b-4f7d-a740-bf4d70cc173d req-1b55bd66-1289-4140-8be0-e98627d174da service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f for instance with vm_state building and task_state spawning.
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: INFO nova.compute.manager [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Detaching volume 40c567bf-1384-4153-b228-e69327aa9b93
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: INFO nova.virt.block_device [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Attempting to driver detach volume 40c567bf-1384-4153-b228-e69327aa9b93 from mountpoint /dev/sdc
Aug 27 03:43:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Attempting to detach device sdc from instance 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:43:09 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:09 user nova-compute[72990]:   <source dev="/dev/sdf"/>
Aug 27 03:43:09 user nova-compute[72990]:   <target dev="sdc" bus="scsi"/>
Aug 27 03:43:09 user nova-compute[72990]:   <serial>40c567bf-1384-4153-b228-e69327aa9b93</serial>
Aug 27 03:43:09 user nova-compute[72990]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 27 03:43:09 user nova-compute[72990]: </disk>
Aug 27 03:43:09 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:43:09 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Successfully detached device sdc from instance 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e from the persistent domain config.
Aug 27 03:43:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:43:09 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:09 user nova-compute[72990]:   <source dev="/dev/sdf"/>
Aug 27 03:43:09 user nova-compute[72990]:   <target dev="sdc" bus="scsi"/>
Aug 27 03:43:09 user nova-compute[72990]:   <serial>40c567bf-1384-4153-b228-e69327aa9b93</serial>
Aug 27 03:43:09 user nova-compute[72990]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 27 03:43:09 user nova-compute[72990]: </disk>
Aug 27 03:43:09 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-71085637-4dc3-4544-999d-cabc5c73c87b req-cba3ec1e-3fbc-4f11-b5d9-ba1d7786411c service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-3317df18-83e4-4bba-9edb-ca6db2cc4295 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-71085637-4dc3-4544-999d-cabc5c73c87b req-cba3ec1e-3fbc-4f11-b5d9-ba1d7786411c service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-71085637-4dc3-4544-999d-cabc5c73c87b req-cba3ec1e-3fbc-4f11-b5d9-ba1d7786411c service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-71085637-4dc3-4544-999d-cabc5c73c87b req-cba3ec1e-3fbc-4f11-b5d9-ba1d7786411c service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-71085637-4dc3-4544-999d-cabc5c73c87b req-cba3ec1e-3fbc-4f11-b5d9-ba1d7786411c service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-3317df18-83e4-4bba-9edb-ca6db2cc4295 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:09 user nova-compute[72990]: WARNING nova.compute.manager [req-71085637-4dc3-4544-999d-cabc5c73c87b req-cba3ec1e-3fbc-4f11-b5d9-ba1d7786411c service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-3317df18-83e4-4bba-9edb-ca6db2cc4295 for instance with vm_state building and task_state spawning.
Aug 27 03:43:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-71085637-4dc3-4544-999d-cabc5c73c87b req-cba3ec1e-3fbc-4f11-b5d9-ba1d7786411c service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-71085637-4dc3-4544-999d-cabc5c73c87b req-cba3ec1e-3fbc-4f11-b5d9-ba1d7786411c service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-71085637-4dc3-4544-999d-cabc5c73c87b req-cba3ec1e-3fbc-4f11-b5d9-ba1d7786411c service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-71085637-4dc3-4544-999d-cabc5c73c87b req-cba3ec1e-3fbc-4f11-b5d9-ba1d7786411c service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-71085637-4dc3-4544-999d-cabc5c73c87b req-cba3ec1e-3fbc-4f11-b5d9-ba1d7786411c service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:09 user nova-compute[72990]: WARNING nova.compute.manager [req-71085637-4dc3-4544-999d-cabc5c73c87b req-cba3ec1e-3fbc-4f11-b5d9-ba1d7786411c service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-515abaa3-8010-44ee-b397-e0858b8a3d3e for instance with vm_state building and task_state spawning.
Aug 27 03:43:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-03596327-0de9-4c2e-ba62-8e50ce89c9f5 req-9f0cc9ea-0b06-4f53-a8d1-b630e4b732ff service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03596327-0de9-4c2e-ba62-8e50ce89c9f5 req-9f0cc9ea-0b06-4f53-a8d1-b630e4b732ff service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03596327-0de9-4c2e-ba62-8e50ce89c9f5 req-9f0cc9ea-0b06-4f53-a8d1-b630e4b732ff service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03596327-0de9-4c2e-ba62-8e50ce89c9f5 req-9f0cc9ea-0b06-4f53-a8d1-b630e4b732ff service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-03596327-0de9-4c2e-ba62-8e50ce89c9f5 req-9f0cc9ea-0b06-4f53-a8d1-b630e4b732ff service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:10 user nova-compute[72990]: WARNING nova.compute.manager [req-03596327-0de9-4c2e-ba62-8e50ce89c9f5 req-9f0cc9ea-0b06-4f53-a8d1-b630e4b732ff service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 for instance with vm_state building and task_state spawning.
Aug 27 03:43:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693107790.5839996, 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:43:10 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Successfully detached device sdc from instance 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e from the live domain config.
Aug 27 03:43:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwLCtzWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:10 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[765693e8-2f48-4a68-a0d0-d9e6935def90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa63af0-bda0-46ca-a451-e38b1d50da72]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:10 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:10 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:10 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:10 user nova-compute[72990]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 (non-flash)
Aug 27 03:43:10 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:10 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:10 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:10 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:10 user nova-compute[72990]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 (non-flash)
Aug 27 03:43:10 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7236fe0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93'): ({'sdf'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Removing single pathed devices sdf {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ea6f36-55f1-49c8-998b-f1276978dea3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[be60db93-ac27-4f92-bd87-466b68d5a12b]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Flushing IO for device /dev/sdf {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d637653f-a3f4-496d-ae0b-c15df765012f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b785a3-4b3a-4dd1-8336-3418facaadba]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] SCSI volumes sdf have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a916c6-e1af-47b6-a429-76302c93f310]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[474bc10c-35e0-45e3-8dbd-584f2327f188]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93, portal: 172.16.0.220,3260]
Aug 27 03:43:10 user nova-compute[72990]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:10 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40c567bf-1384-4153-b228-e69327aa9b93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb462e0-86a0-4039-becf-9902e065259a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] <== disconnect_volume: return (370ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-ae508e30-f3d5-47ca-8b71-d0217d532e6e req-60adb071-a525-4879-a473-7d78183db671 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ae508e30-f3d5-47ca-8b71-d0217d532e6e req-60adb071-a525-4879-a473-7d78183db671 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ae508e30-f3d5-47ca-8b71-d0217d532e6e req-60adb071-a525-4879-a473-7d78183db671 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ae508e30-f3d5-47ca-8b71-d0217d532e6e req-60adb071-a525-4879-a473-7d78183db671 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-ae508e30-f3d5-47ca-8b71-d0217d532e6e req-60adb071-a525-4879-a473-7d78183db671 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:11 user nova-compute[72990]: WARNING nova.compute.manager [req-ae508e30-f3d5-47ca-8b71-d0217d532e6e req-60adb071-a525-4879-a473-7d78183db671 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f for instance with vm_state building and task_state spawning.
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBYmbDE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:11 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:11 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:11 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74c0c9b-b18a-43d4-9160-a566e18c9175]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:43:11 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70dccd8-5480-40bc-997e-be6de235a04a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5] added
Aug 27 03:43:11 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d23b7b-1cd6-4102-8a4d-05827fbfb50a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c87c7c-c2d9-437c-9cf1-d34ee09a82b9]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQBYmbDE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQBYmbDE" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f7dd53-3a07-4fcf-977b-c5c22288e7de]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yQBYmbDE'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[308bbadc-183b-4961-b48f-1b95dd7897ae]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cf4016-219f-420c-8562-4d36449d9502]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fed5608-0d0e-4c60-9090-1f15df48b444]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5, portal: 172.16.0.220,3260]
Aug 27 03:43:11 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:11 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[949602bb-27fc-4a38-8da3-f38cbeb5676e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:11 user nova-compute[72990]: WARNING nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-515abaa3-8010-44ee-b397-e0858b8a3d3e for instance with vm_state building and task_state spawning.
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:11 user nova-compute[72990]: WARNING nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-cfcfd098-0086-428d-80a8-7c7d408afc3e for instance with vm_state building and task_state spawning.
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:11 user nova-compute[72990]: WARNING nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-cfcfd098-0086-428d-80a8-7c7d408afc3e for instance with vm_state building and task_state spawning.
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:11 user nova-compute[72990]: WARNING nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c for instance with vm_state building and task_state spawning.
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:11 user nova-compute[72990]: WARNING nova.compute.manager [req-063d6f05-56fd-4736-9a4e-fb79275d436e req-d3bec0f4-98e6-4382-ae50-244e870b54c1 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c for instance with vm_state building and task_state spawning.
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5d354-8e0b-45ab-8d67-57b233eeac67]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 (non-flash)
Aug 27 03:43:11 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e823f66b-90a4-4244-ba0c-ac747986417b]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.objects.instance [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lazy-loading 'flavor' on Instance uuid 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-43ce727b-097a-4759-a9e4-3a5bd225eb7b tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.521s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107792.63764, bbab26b4-9515-4427-a01c-04f4a85b1fa8 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:43:12 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] VM Resumed (Lifecycle Event)
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:43:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Instance spawned successfully.
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:12 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107792.6395993, bbab26b4-9515-4427-a01c-04f4a85b1fa8 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:43:12 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] VM Started (Lifecycle Event)
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:43:12 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:43:12 user nova-compute[72990]: INFO nova.compute.manager [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Took 13.22 seconds to spawn the instance on the hypervisor.
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBYmbDE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26264656465333765', 'path': '/dev/sdf'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264656465333765', 'path': '/dev/sdf'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:43:12 user nova-compute[72990]: INFO nova.compute.manager [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Took 53.59 seconds to build instance.
Aug 27 03:43:12 user nova-compute[72990]: DEBUG nova.objects.instance [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lazy-loading 'flavor' on Instance uuid bc82cced-9f16-44bc-b9bc-622fa99b1be0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d7fe67b6-bc70-470d-b6b7-04d49fc4e689 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.730s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:43:13 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:13 user nova-compute[72990]:   <source dev="/dev/sdf"/>
Aug 27 03:43:13 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:43:13 user nova-compute[72990]:   <serial>805ebe7f-8866-46e7-92b9-944dfb5c08f5</serial>
Aug 27 03:43:13 user nova-compute[72990]: </disk>
Aug 27 03:43:13 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] No VIF found with MAC fa:16:3e:b7:4e:53, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:13 user nova-compute[72990]: INFO nova.compute.manager [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Terminating instance
Aug 27 03:43:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-b4dac90b-e892-4b3c-92d6-1c7472990d0f req-5f3daf1c-9593-46f1-867a-e579d8e8da4d service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Received event network-changed-75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-b4dac90b-e892-4b3c-92d6-1c7472990d0f req-5f3daf1c-9593-46f1-867a-e579d8e8da4d service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Refreshing instance network info cache due to event network-changed-75916180-ab9a-4930-9c30-b2b67b3284d3. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b4dac90b-e892-4b3c-92d6-1c7472990d0f req-5f3daf1c-9593-46f1-867a-e579d8e8da4d service nova] Acquiring lock "refresh_cache-a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b4dac90b-e892-4b3c-92d6-1c7472990d0f req-5f3daf1c-9593-46f1-867a-e579d8e8da4d service nova] Acquired lock "refresh_cache-a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG nova.network.neutron [req-b4dac90b-e892-4b3c-92d6-1c7472990d0f req-5f3daf1c-9593-46f1-867a-e579d8e8da4d service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Refreshing network info cache for port 75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Acquiring lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lazy-loading 'flavor' on Instance uuid a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-83827d28-f69a-40d7-8fb3-2871f0a8764a tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.188s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.166s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Acquiring lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:13 user nova-compute[72990]: INFO nova.compute.manager [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Attaching volume 605c7f2e-a9af-4b7a-8f09-17105b4f830f to /dev/vdb
Aug 27 03:43:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a63ecbb6-9d15-496d-a6fb-27030153df9a req-fce8ef77-6a4c-4276-835a-e826386886e7 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Received event network-vif-unplugged-0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a63ecbb6-9d15-496d-a6fb-27030153df9a req-fce8ef77-6a4c-4276-835a-e826386886e7 service nova] Acquiring lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a63ecbb6-9d15-496d-a6fb-27030153df9a req-fce8ef77-6a4c-4276-835a-e826386886e7 service nova] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a63ecbb6-9d15-496d-a6fb-27030153df9a req-fce8ef77-6a4c-4276-835a-e826386886e7 service nova] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a63ecbb6-9d15-496d-a6fb-27030153df9a req-fce8ef77-6a4c-4276-835a-e826386886e7 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] No waiting events found dispatching network-vif-unplugged-0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a63ecbb6-9d15-496d-a6fb-27030153df9a req-fce8ef77-6a4c-4276-835a-e826386886e7 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Received event network-vif-unplugged-0ac002a5-64fb-40b4-8da9-22b54f104689 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG os_brick.utils [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0de7c3-fc25-4842-9615-0630b9f8be27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c607120-9b66-41fa-9aca-de0c01130533]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de71e47-1af4-426d-aae7-76de5fd6d23b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc73784-9746-4ab9-a0b5-4eed66becd87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:43:14 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[55851df5-e3fe-4056-96e1-96f980fb525a]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG os_brick.utils [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Updating existing volume attachment record: 120f57ee-fbe3-4610-b64c-fa3cd1de08a1 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Instance destroyed successfully.
Aug 27 03:43:14 user nova-compute[72990]: DEBUG nova.objects.instance [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lazy-loading 'resources' on Instance uuid 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1085982954',display_name='tempest-AttachSCSIVolumeTestJSON-server-1085982954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1085982954',id=7,image_ref='85c450f2-38e4-4c4f-b26b-5ea730022b5c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5UZrdz8DkfGMyKoWtbnGqZSmpO1ZqhLMhzkOc2xvcCLDDksg5gGjhzu/g2CFaYiV4bE/puczfBtx/uaUROhz7fGQlEHE5mSt86Hnlnu/6EX0KM1EVthjV6+NcDHWDxGw==',key_name='tempest-keypair-1707821719',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e206c0eeae224e4a985ee0d49c42a051',ramdisk_id='',reservation_id='r-hq3h824e',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='85c450f2-38e4-4c4f-b26b-5ea730022b5c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1947338428',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1947338428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0b94da4a8ca4450ab0c5989e5dfd5e3',uuid=3cb2360e-e8b2-48c0-96d4-cde86cf1a28e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ac002a5-64fb-40b4-8da9-22b54f104689", "address": "fa:16:3e:08:63:16", "network": {"id": "198f33b4-c259-4dea-9f48-11e7d97c8cd4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1964452619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e206c0eeae224e4a985ee0d49c42a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac002a5-64", "ovs_interfaceid": "0ac002a5-64fb-40b4-8da9-22b54f104689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Converting VIF {"id": "0ac002a5-64fb-40b4-8da9-22b54f104689", "address": "fa:16:3e:08:63:16", "network": {"id": "198f33b4-c259-4dea-9f48-11e7d97c8cd4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1964452619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e206c0eeae224e4a985ee0d49c42a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac002a5-64", "ovs_interfaceid": "0ac002a5-64fb-40b4-8da9-22b54f104689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:63:16,bridge_name='br-int',has_traffic_filtering=True,id=0ac002a5-64fb-40b4-8da9-22b54f104689,network=Network(198f33b4-c259-4dea-9f48-11e7d97c8cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac002a5-64') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG os_vif [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:63:16,bridge_name='br-int',has_traffic_filtering=True,id=0ac002a5-64fb-40b4-8da9-22b54f104689,network=Network(198f33b4-c259-4dea-9f48-11e7d97c8cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac002a5-64') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ac002a5-64, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:43:14 user nova-compute[72990]: INFO os_vif [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:63:16,bridge_name='br-int',has_traffic_filtering=True,id=0ac002a5-64fb-40b4-8da9-22b54f104689,network=Network(198f33b4-c259-4dea-9f48-11e7d97c8cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac002a5-64')
Aug 27 03:43:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Deleting instance files /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e_del
Aug 27 03:43:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Deletion of /opt/stack/data/nova/instances/3cb2360e-e8b2-48c0-96d4-cde86cf1a28e_del complete
Aug 27 03:43:14 user nova-compute[72990]: DEBUG nova.network.neutron [req-b4dac90b-e892-4b3c-92d6-1c7472990d0f req-5f3daf1c-9593-46f1-867a-e579d8e8da4d service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Updated VIF entry in instance network info cache for port 75916180-ab9a-4930-9c30-b2b67b3284d3. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG nova.network.neutron [req-b4dac90b-e892-4b3c-92d6-1c7472990d0f req-5f3daf1c-9593-46f1-867a-e579d8e8da4d service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Updating instance_info_cache with network_info: [{"id": "75916180-ab9a-4930-9c30-b2b67b3284d3", "address": "fa:16:3e:ca:eb:1e", "network": {"id": "681b81c3-eae5-44a6-8cc5-f75f95fd1a40", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1610213912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc61380783bd4439a0f3205d0e5cfa1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75916180-ab", "ovs_interfaceid": "75916180-ab9a-4930-9c30-b2b67b3284d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b4dac90b-e892-4b3c-92d6-1c7472990d0f req-5f3daf1c-9593-46f1-867a-e579d8e8da4d service nova] Releasing lock "refresh_cache-a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:43:14 user nova-compute[72990]: INFO nova.compute.manager [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 27 03:43:14 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:43:14 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:43:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:15 user nova-compute[72990]: INFO nova.compute.manager [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Detaching volume 805ebe7f-8866-46e7-92b9-944dfb5c08f5
Aug 27 03:43:15 user nova-compute[72990]: INFO nova.virt.block_device [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Attempting to driver detach volume 805ebe7f-8866-46e7-92b9-944dfb5c08f5 from mountpoint /dev/vdb
Aug 27 03:43:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Attempting to detach device vdb from instance bc82cced-9f16-44bc-b9bc-622fa99b1be0 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:43:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:43:15 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:15 user nova-compute[72990]:   <source dev="/dev/sdf"/>
Aug 27 03:43:15 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:43:15 user nova-compute[72990]:   <serial>805ebe7f-8866-46e7-92b9-944dfb5c08f5</serial>
Aug 27 03:43:15 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:43:15 user nova-compute[72990]: </disk>
Aug 27 03:43:15 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:43:15 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Successfully detached device vdb from instance bc82cced-9f16-44bc-b9bc-622fa99b1be0 from the persistent domain config.
Aug 27 03:43:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc82cced-9f16-44bc-b9bc-622fa99b1be0 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:43:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:43:15 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:15 user nova-compute[72990]:   <source dev="/dev/sdf"/>
Aug 27 03:43:15 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:43:15 user nova-compute[72990]:   <serial>805ebe7f-8866-46e7-92b9-944dfb5c08f5</serial>
Aug 27 03:43:15 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:43:15 user nova-compute[72990]: </disk>
Aug 27 03:43:15 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:43:15 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:43:15 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Took 1.35 seconds to deallocate network for instance.
Aug 27 03:43:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-c41da86e-1f71-40bb-880e-4cd9e5431036 req-c2fb0213-e9a3-4598-8b6c-c39f6e60a264 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Received event network-vif-plugged-0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c41da86e-1f71-40bb-880e-4cd9e5431036 req-c2fb0213-e9a3-4598-8b6c-c39f6e60a264 service nova] Acquiring lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c41da86e-1f71-40bb-880e-4cd9e5431036 req-c2fb0213-e9a3-4598-8b6c-c39f6e60a264 service nova] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c41da86e-1f71-40bb-880e-4cd9e5431036 req-c2fb0213-e9a3-4598-8b6c-c39f6e60a264 service nova] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-c41da86e-1f71-40bb-880e-4cd9e5431036 req-c2fb0213-e9a3-4598-8b6c-c39f6e60a264 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] No waiting events found dispatching network-vif-plugged-0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:16 user nova-compute[72990]: WARNING nova.compute.manager [req-c41da86e-1f71-40bb-880e-4cd9e5431036 req-c2fb0213-e9a3-4598-8b6c-c39f6e60a264 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Received unexpected event network-vif-plugged-0ac002a5-64fb-40b4-8da9-22b54f104689 for instance with vm_state deleted and task_state None.
Aug 27 03:43:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-c41da86e-1f71-40bb-880e-4cd9e5431036 req-c2fb0213-e9a3-4598-8b6c-c39f6e60a264 service nova] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Received event network-vif-deleted-0ac002a5-64fb-40b4-8da9-22b54f104689 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693107796.1955285, bc82cced-9f16-44bc-b9bc-622fa99b1be0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc82cced-9f16-44bc-b9bc-622fa99b1be0 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:43:16 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Successfully detached device vdb from instance bc82cced-9f16-44bc-b9bc-622fa99b1be0 from the live domain config.
Aug 27 03:43:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBYmbDE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:16 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[128a84b7-5a46-4157-a344-3b82a2314428]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilpxscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:16 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a4464d-203d-4ca3-9279-57ecb718218e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa714548160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5'): ({'sdf'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Removing single pathed devices sdf {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29bc6e1-4b83-4ef4-8f29-0e8b4b7f7bec]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfda3f3-2705-437e-8f2e-a3bcb1f7fe74]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Flushing IO for device /dev/sdf {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff12fd84-3a52-414d-91f5-3437c616a2f6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabddf3e-0f64-45ef-9931-65b43525632f]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] SCSI volumes sdf have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Deleted allocations for instance 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d749422f-0b8c-4c8f-8047-d47f434f589d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f027a6-8589-4203-b447-09d3fc4c9c2d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5, portal: 172.16.0.220,3260]
Aug 27 03:43:16 user nova-compute[72990]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:805ebe7f-8866-46e7-92b9-944dfb5c08f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af3a174-8ac4-46c5-9ca6-70524452e7b5]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] <== disconnect_volume: return (347ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.290s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:16 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:16 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-da1b7850-8481-4ed7-8544-d6109eac9149 tempest-AttachSCSIVolumeTestJSON-1947338428 tempest-AttachSCSIVolumeTestJSON-1947338428-project-member] Lock "3cb2360e-e8b2-48c0-96d4-cde86cf1a28e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.116s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e5b74c-a746-4fb7-b7ae-28032388c158]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:43:16 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca2bf7f-b4c9-41f4-8971-5b1b27a84cc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7] added
Aug 27 03:43:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[93db6214-4f37-4df2-b709-f9214c036052]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd80ee3f-1996-4d95-9ec7-d9962c91defb]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wilpxscQ {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wilpxscQ" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f6ebac-4de2-4c30-bbbb-3db61077d0f3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wilpxscQ'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6deca8-c15b-470a-912d-2920182d87b2]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5692fabd-4f88-4c9c-96c4-05049341840c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b283aa-eb84-4143-9bd0-0633b9e9debc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260]
Aug 27 03:43:16 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[969150f4-238f-43a4-bb58-c6fab62274bb]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f8fd49-cb2a-420d-a30b-5990d9e010d9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2b38a2-29db-4a20-8cfc-d765c214baf0]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilpxscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:43:17 user nova-compute[72990]: DEBUG nova.objects.instance [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lazy-loading 'flavor' on Instance uuid bc82cced-9f16-44bc-b9bc-622fa99b1be0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8bcf3e15-f6e0-4ef6-a2e8-db4f7ff70503 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.981s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:17 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:43:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] <== connect_volume: return (1716ms) {'type': 'block', 'scsi_wwn': '23536346161626134', 'path': '/dev/sdf'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536346161626134', 'path': '/dev/sdf'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:43:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lazy-loading 'flavor' on Instance uuid a388d657-a11d-4a63-b7fc-2df799ca72d0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:43:18 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:18 user nova-compute[72990]:   <source dev="/dev/sdf"/>
Aug 27 03:43:18 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:43:18 user nova-compute[72990]:   <serial>8e14715b-7629-40da-89fb-5982d92f42b7</serial>
Aug 27 03:43:18 user nova-compute[72990]: </disk>
Aug 27 03:43:18 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:43:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:43:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:43:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] No VIF found with MAC fa:16:3e:1d:b5:ae, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:43:18 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:43:18 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:43:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-de3f5e84-91bf-444c-be5e-d91b3c496c2c tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.888s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Acquiring lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG os_brick.utils [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc46d5-83c2-4245-bec4-0df69b2d6b2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada22186-0c51-4cbc-bdac-ac573941112e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dab613-b09d-4798-b765-b898482e3e83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8ee572-7860-4518-9eb3-7c1306775e68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:43:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:43:20 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:43:20 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaf34df-3102-4ccc-9c95-d8f43af30eca]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG os_brick.utils [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:20 user nova-compute[72990]: INFO nova.compute.manager [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Swapping volume 8e14715b-7629-40da-89fb-5982d92f42b7 for 412abe10-ac40-4fb2-ad36-8ac399108932
Aug 27 03:43:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "7114903d-465a-4ef6-b436-88af52261eae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:43:22 user nova-compute[72990]: INFO nova.compute.claims [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Claim successful on node user
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:43:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:43:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:43:23 user nova-compute[72990]: INFO nova.virt.block_device [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Booting with blank volume at /dev/vda
Aug 27 03:43:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG nova.policy [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '858a63e8d5964f38ad776985cfbe9121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183297ba5b6549fdb39f2135d92b3794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:43:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:43:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:43:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:43:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:43:24 user nova-compute[72990]: DEBUG nova.network.neutron [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Successfully created port: 8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:43:25 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:43:25 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=6959MB free_disk=25.462543487548828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 970ca110-30d7-4e41-92d3-aa4e0bda4482 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bc82cced-9f16-44bc-b9bc-622fa99b1be0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance a388d657-a11d-4a63-b7fc-2df799ca72d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bbab26b4-9515-4427-a01c-04f4a85b1fa8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance e4842b80-80e8-4df9-a4bb-30529de4a013 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Successfully updated port: 8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquired lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-c2893369-3fee-4271-a8c6-e7a1418a5db3 req-2055a27e-78fe-47c6-b7f6-22e5f8442e3b service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-changed-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-c2893369-3fee-4271-a8c6-e7a1418a5db3 req-2055a27e-78fe-47c6-b7f6-22e5f8442e3b service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Refreshing instance network info cache due to event network-changed-8bd721fc-ebab-49ab-9c7d-f900107b74b2. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c2893369-3fee-4271-a8c6-e7a1418a5db3 req-2055a27e-78fe-47c6-b7f6-22e5f8442e3b service nova] Acquiring lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Updating instance_info_cache with network_info: [{"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:43:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Releasing lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:43:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Instance network_info: |[{"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:43:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c2893369-3fee-4271-a8c6-e7a1418a5db3 req-2055a27e-78fe-47c6-b7f6-22e5f8442e3b service nova] Acquired lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:43:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-c2893369-3fee-4271-a8c6-e7a1418a5db3 req-2055a27e-78fe-47c6-b7f6-22e5f8442e3b service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Refreshing network info cache for port 8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:43:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-c2893369-3fee-4271-a8c6-e7a1418a5db3 req-2055a27e-78fe-47c6-b7f6-22e5f8442e3b service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Updated VIF entry in instance network info cache for port 8bd721fc-ebab-49ab-9c7d-f900107b74b2. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:43:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-c2893369-3fee-4271-a8c6-e7a1418a5db3 req-2055a27e-78fe-47c6-b7f6-22e5f8442e3b service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Updating instance_info_cache with network_info: [{"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:43:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c2893369-3fee-4271-a8c6-e7a1418a5db3 req-2055a27e-78fe-47c6-b7f6-22e5f8442e3b service nova] Releasing lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:43:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:43:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:43:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:43:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNiJjuvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:27 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:27 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:27 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:43:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:43:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:43:27 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7d7f73-7cbe-40c1-86a0-d2d20a779968]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:43:28 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b0d62-57e9-402d-9781-b9609fd42542]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f] added
Aug 27 03:43:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a0cdf8-297c-4d89-9125-15bce32d0448]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5816ec68-833b-4e61-9152-6557ee7a79c7]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNiJjuvb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNiJjuvb" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[295049d1-d654-4bdd-a7cd-849876320e8d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mNiJjuvb'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2d4ad5-4c10-4618-ab27-f8e4e01072ad]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0332cf-0638-49de-ac2c-5d23edf37471]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b357791-c614-43f1-8b69-0a329243c398]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f, portal: 172.16.0.220,3260]
Aug 27 03:43:28 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[730d1307-5366-4dcd-81e3-6b4547a5fb78]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c89c3f6-c9be-4a9c-bd06-adf01a5c0fe7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f (non-flash)
Aug 27 03:43:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:28 user nova-compute[72990]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f (non-flash)
Aug 27 03:43:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8623bf14-29c2-4bd4-af83-e862e16ed99d]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNiJjuvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Updating instance_info_cache with network_info: [{"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:43:28 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG os_brick.utils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4aeb60-5764-4871-8611-632bd605f728]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ddaed0-f2e4-4948-ac10-cbf76632a031]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cee38a7-ea93-46e5-bdd1-058f074cedf8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[101964e8-b476-4514-8855-0e92686eef24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:43:29 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:43:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd907ea0-961b-4e31-8696-238c507dd530]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG os_brick.utils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Updating existing volume attachment record: f8c99d31-1d5e-4ba1-8b3e-69d27b6b3aea {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693107794.3249745, 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:43:29 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] VM Stopped (Lifecycle Event)
Aug 27 03:43:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2bb134e8-c462-4c70-85e8-ab1f3a080322 None None] [instance: 3cb2360e-e8b2-48c0-96d4-cde86cf1a28e] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23063313533656661', 'path': '/dev/sdg'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063313533656661', 'path': '/dev/sdg'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lazy-loading 'flavor' on Instance uuid a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] attach device xml: <disk type="block" device="disk">
Aug 27 03:43:29 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:29 user nova-compute[72990]:   <source dev="/dev/sdg"/>
Aug 27 03:43:29 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:43:29 user nova-compute[72990]:   <serial>605c7f2e-a9af-4b7a-8f09-17105b4f830f</serial>
Aug 27 03:43:29 user nova-compute[72990]: </disk>
Aug 27 03:43:29 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:43:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] No VIF found with MAC fa:16:3e:ca:eb:1e, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:43:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9a0697c1-cd34-427d-a786-3cc5afc489bb tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.084s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-80e86d8f-d439-4300-b597-3199fb0f715d tempest-VolumesAssistedSnapshotsTest-1002356547 tempest-VolumesAssistedSnapshotsTest-1002356547-project] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] volume_snapshot_create: create_info: {'snapshot_id': '89ac7df3-6f0a-4241-8506-9ff7b8e7d051', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72990) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 27 03:43:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-80e86d8f-d439-4300-b597-3199fb0f715d tempest-VolumesAssistedSnapshotsTest-1002356547 tempest-VolumesAssistedSnapshotsTest-1002356547-project] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] snap xml: <domainsnapshot>
Aug 27 03:43:31 user nova-compute[72990]:   <disks>
Aug 27 03:43:31 user nova-compute[72990]:     <disk name="/dev/sdg" snapshot="external" type="file">
Aug 27 03:43:31 user nova-compute[72990]:       <source file="/dev/new_file"/>
Aug 27 03:43:31 user nova-compute[72990]:     </disk>
Aug 27 03:43:31 user nova-compute[72990]:     <disk name="vda" snapshot="no"/>
Aug 27 03:43:31 user nova-compute[72990]:   </disks>
Aug 27 03:43:31 user nova-compute[72990]: </domainsnapshot>
Aug 27 03:43:31 user nova-compute[72990]:  {{(pid=72990) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 27 03:43:31 user nova-compute[72990]: DEBUG nova.objects.instance [None req-80e86d8f-d439-4300-b597-3199fb0f715d tempest-VolumesAssistedSnapshotsTest-1002356547 tempest-VolumesAssistedSnapshotsTest-1002356547-project] Lazy-loading 'system_metadata' on Instance uuid a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:31 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-80e86d8f-d439-4300-b597-3199fb0f715d tempest-VolumesAssistedSnapshotsTest-1002356547 tempest-VolumesAssistedSnapshotsTest-1002356547-project] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [None req-80e86d8f-d439-4300-b597-3199fb0f715d tempest-VolumesAssistedSnapshotsTest-1002356547 tempest-VolumesAssistedSnapshotsTest-1002356547-project] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Traceback (most recent call last):
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     rv = execute(f, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     six.reraise(c, e, tb)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     raise value
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     rv = meth(*args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] 
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [None req-80e86d8f-d439-4300-b597-3199fb0f715d tempest-VolumesAssistedSnapshotsTest-1002356547 tempest-VolumesAssistedSnapshotsTest-1002356547-project] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Traceback (most recent call last):
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     self._volume_snapshot_create(context, instance, guest,
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     rv = execute(f, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     six.reraise(c, e, tb)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     raise value
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     rv = meth(*args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] 
Aug 27 03:43:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-53734107-0f45-4fa1-9d5c-446a7aaaac7f tempest-VolumesAssistedSnapshotsTest-1002356547 tempest-VolumesAssistedSnapshotsTest-1002356547-project] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] volume_snapshot_delete: delete_info: {'volume_id': '605c7f2e-a9af-4b7a-8f09-17105b4f830f'} {{(pid=72990) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [None req-53734107-0f45-4fa1-9d5c-446a7aaaac7f tempest-VolumesAssistedSnapshotsTest-1002356547 tempest-VolumesAssistedSnapshotsTest-1002356547-project] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Traceback (most recent call last):
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63]     if delete_info['type'] != 'qcow2':
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] KeyError: 'type'
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] 
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [None req-80e86d8f-d439-4300-b597-3199fb0f715d tempest-VolumesAssistedSnapshotsTest-1002356547 tempest-VolumesAssistedSnapshotsTest-1002356547-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 89ac7df3-6f0a-4241-8506-9ff7b8e7d051 could not be found.
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     raise value
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver 
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver 
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 89ac7df3-6f0a-4241-8506-9ff7b8e7d051 could not be found. (HTTP 404) (Request-ID: req-63dd1228-572d-45e0-af47-85c66e6e5926)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver 
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver 
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 89ac7df3-6f0a-4241-8506-9ff7b8e7d051 could not be found.
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver 
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server [None req-80e86d8f-d439-4300-b597-3199fb0f715d tempest-VolumesAssistedSnapshotsTest-1002356547 tempest-VolumesAssistedSnapshotsTest-1002356547-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     raise value
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server 
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver [None req-53734107-0f45-4fa1-9d5c-446a7aaaac7f tempest-VolumesAssistedSnapshotsTest-1002356547 tempest-VolumesAssistedSnapshotsTest-1002356547-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver 
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver 
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-9d6f7927-2d61-4649-bf7b-be5e3ae11dd1)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver 
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver 
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 27 03:43:31 user nova-compute[72990]: ERROR nova.virt.libvirt.driver 
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server [None req-53734107-0f45-4fa1-9d5c-446a7aaaac7f tempest-VolumesAssistedSnapshotsTest-1002356547 tempest-VolumesAssistedSnapshotsTest-1002356547-project] Exception during message handling: KeyError: 'type'
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 27 03:43:31 user nova-compute[72990]: ERROR oslo_messaging.rpc.server 
Aug 27 03:43:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Acquiring lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:31 user nova-compute[72990]: INFO nova.compute.manager [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Detaching volume 605c7f2e-a9af-4b7a-8f09-17105b4f830f
Aug 27 03:43:31 user nova-compute[72990]: INFO nova.virt.block_device [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Attempting to driver detach volume 605c7f2e-a9af-4b7a-8f09-17105b4f830f from mountpoint /dev/vdb
Aug 27 03:43:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Attempting to detach device vdb from instance a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:43:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] detach device xml: <disk type="block" device="disk">
Aug 27 03:43:31 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:31 user nova-compute[72990]:   <source dev="/dev/sdg"/>
Aug 27 03:43:31 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:43:31 user nova-compute[72990]:   <serial>605c7f2e-a9af-4b7a-8f09-17105b4f830f</serial>
Aug 27 03:43:31 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:43:31 user nova-compute[72990]: </disk>
Aug 27 03:43:31 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:43:31 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Successfully detached device vdb from instance a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 from the persistent domain config.
Aug 27 03:43:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:43:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] detach device xml: <disk type="block" device="disk">
Aug 27 03:43:31 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:31 user nova-compute[72990]:   <source dev="/dev/sdg"/>
Aug 27 03:43:31 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:43:31 user nova-compute[72990]:   <serial>605c7f2e-a9af-4b7a-8f09-17105b4f830f</serial>
Aug 27 03:43:31 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:43:31 user nova-compute[72990]: </disk>
Aug 27 03:43:31 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:43:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693107812.2247689, a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:43:32 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Successfully detached device vdb from instance a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 from the live domain config.
Aug 27 03:43:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNiJjuvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:32 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cb10c0-e0a3-48a8-adeb-b2f5845ea302]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f837425-dacd-427d-9f40-5d52a635a9fd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:32 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:32 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:32 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:32 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:32 user nova-compute[72990]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f (non-flash)
Aug 27 03:43:32 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:32 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:32 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:32 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:32 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:32 user nova-compute[72990]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f (non-flash)
Aug 27 03:43:32 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f46ea200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f'): ({'sdg'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Removing single pathed devices sdg {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fa15a5-e3a0-491b-ac74-97cf2a42c229]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f93d6a1-9b47-4932-804f-00eefb3e9110]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Flushing IO for device /dev/sdg {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[89239ef0-4014-47e0-b4d5-fcb137801418]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.060s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a72547-a4d9-4544-bea4-5da08aa450c2]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] SCSI volumes sdg have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1e24e9-cc14-4606-9c61-b5f80bcdb030]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[54018b1b-13b0-4a0b-b591-86f821cd815f]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f, portal: 172.16.0.220,3260]
Aug 27 03:43:32 user nova-compute[72990]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:32 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605c7f2e-a9af-4b7a-8f09-17105b4f830f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[16095023-41a5-402a-a1cb-bf2e09eedabe]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] <== disconnect_volume: return (338ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG nova.objects.instance [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lazy-loading 'flavor' on Instance uuid a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYcmSVbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a388d657-a11d-4a63-b7fc-2df799ca72d0', 'attached_at': '', 'detached_at': '', 'volume_id': '412abe10-ac40-4fb2-ad36-8ac399108932', 'serial': '412abe10-ac40-4fb2-ad36-8ac399108932'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilpxscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'a388d657-a11d-4a63-b7fc-2df799ca72d0', 'attached_at': '', 'detached_at': '', 'volume_id': '8e14715b-7629-40da-89fb-5982d92f42b7', 'serial'} {{(pid=72990) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYcmSVbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:33 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:33 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:33 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb20204-75df-4f8c-b546-24d6c7e1e8cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:43:33 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e44e4e-64a8-4d75-8b3a-59be93e06ac2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932] added
Aug 27 03:43:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6b3ea1dd-35ee-4f55-bfec-8482d50fd38f tempest-VolumesAssistedSnapshotsTest-1380489713 tempest-VolumesAssistedSnapshotsTest-1380489713-project-admin] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.872s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0b7af2-8e86-49eb-a043-f538b797111b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0295c24a-bac1-4aed-ad07-4f08f69a6de9]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dYcmSVbA {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dYcmSVbA" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c7f356-8ba9-47d5-83cd-e9a7c8a914ee]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dYcmSVbA'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb9b5a9-cdcc-4059-afc6-6a66e18efd17]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb583c1f-4890-48a8-8b7c-00b77e95097d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3a968b-d27e-463e-9762-40d9d22ab755]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932, portal: 172.16.0.220,3260]
Aug 27 03:43:33 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dd08c1-26b8-4421-8c7c-2787b76e62aa]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9997a58a-68e2-4a53-8a59-d100bc3eed0c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcede78-115d-4eb5-9cde-753786203336]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:34 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYcmSVbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:43:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26134663231373961', 'path': '/dev/sdg'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134663231373961', 'path': '/dev/sdg'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:43:34 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lazy-loading 'flavor' on Instance uuid a388d657-a11d-4a63-b7fc-2df799ca72d0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 143654912 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 292552704 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 451936256 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 589299712 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 734003200 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 893386752 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 1056964608 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilpxscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:39 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[750b85fc-2eab-4855-a9b2-5d7575f0b1e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f865ee7e-6b78-426f-b6d9-e3513a8e1e31]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:39 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:39 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:39 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:39 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:39 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:39 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:39 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:39 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:39 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:39 user nova-compute[72990]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7236ff760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7'): ({'sdf'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Removing single pathed devices sdf {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3922c29-e141-4a56-a899-c60657240633]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b05f62d-54fb-445b-9ddf-b807bdd6aabb]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Flushing IO for device /dev/sdf {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8937a67-504e-4828-93fe-5c2955599e88]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fed79ee-080a-40f9-8e11-3cc4fdf0d3bf]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] SCSI volumes sdf have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2192777f-40ad-43ad-a331-164aced6c345]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f943e6f7-a055-403f-9d5b-43e7828e1f31]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260]
Aug 27 03:43:39 user nova-compute[72990]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba2958b-7e6d-459a-af3c-740850f02dc1]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] <== disconnect_volume: return (305ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYcmSVbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'a388d657-a11d-4a63-b7fc-2df799ca72d0', 'attached_at': '', 'detached_at': '', 'volume_id': '412abe10-ac40-4fb2-ad36-8ac399108932', 'serial'} {{(pid=72990) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 27 03:43:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] swap_volume: removing Cinder connection for volume 8e14715b-7629-40da-89fb-5982d92f42b7 {{(pid=72990) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 27 03:43:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] swap_volume: Updating volume 8e14715b-7629-40da-89fb-5982d92f42b7 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "dYcmSVbA", "auth_password": "hMOzJqbf87oCmF", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "412abe10-ac40-4fb2-ad36-8ac399108932"}, "status": "reserved", "instance": "a388d657-a11d-4a63-b7fc-2df799ca72d0", "attached_at": "", "detached_at": "", "volume_id": "412abe10-ac40-4fb2-ad36-8ac399108932", "serial": "412abe10-ac40-4fb2-ad36-8ac399108932"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '412abe10-ac40-4fb2-ad36-8ac399108932', 'no_device': None, 'attachment_id': '3a7e874e-c7dd-4d26-a111-40c772efdd6c'} {{(pid=72990) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 27 03:43:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c4731312-1013-4d34-968e-9b9f6af5879b tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.951s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Acquiring lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG os_brick.utils [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ba6c6d-fbb6-42d7-a81a-0d87cae6ff13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce6a4cb-33d5-49a7-9704-185027517ab3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb6b06a-6ced-43f4-b4e9-4c64dbdf83c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[073c774a-4c50-4369-8fda-67b49d5d5c25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:43:41 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:43:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fe202f-931c-41ad-bf1a-7f7a91155c39]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:43:41 user nova-compute[72990]: DEBUG os_brick.utils [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:41 user nova-compute[72990]: INFO nova.compute.manager [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Swapping volume 412abe10-ac40-4fb2-ad36-8ac399108932 for 8e14715b-7629-40da-89fb-5982d92f42b7
Aug 27 03:43:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:43:43 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Creating image(s)
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Ensure instance console log exists: /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Start _get_guest_xml network_info=[{"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'f8c99d31-1d5e-4ba1-8b3e-69d27b6b3aea', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxIRKtmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7114903d-465a-4ef6-b436-88af52261eae', 'attached_at': '', 'detached_at': '', 'volume_id': '22ce017c-edc6-4e54-bed5-792dc4e365f5', 'serial': '22ce017c-edc6-4e54-bed5-792dc4e365f5'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:43:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:43:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxIRKtmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:43 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:43 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:43 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c838a8-8e34-4ac6-b095-e28124b90a4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:43:43 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb876cc-7d49-4bf2-ab4f-b1c281ef1e27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5] added
Aug 27 03:43:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ac0165-eea3-4f07-a6bb-40bab9d2f087]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2619c501-fb56-4b1f-af84-7f157dd38abc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxIRKtmV {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxIRKtmV" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0d4495-da60-4100-82c2-9020eb38cdf6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FxIRKtmV'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[82741a75-53b3-402e-acc0-1778ec31bd2e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c54035-463f-42d1-96bb-daae1a8fe7b3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc87fbd1-0bb4-48dc-81fe-106bd12db6d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5, portal: 172.16.0.220,3260]
Aug 27 03:43:43 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2022ea2-f1f1-4ce0-98b1-6a3d8548d2a3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba2aa0b-9e20-41ae-b74c-70139042d11f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0ae69f-cfba-4dc0-b921-d821f3f5617d]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxIRKtmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23166653731653864', 'path': '/dev/sdf'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166653731653864', 'path': '/dev/sdf'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334572128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-334572128',id=13,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-qru8dfhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:43:24Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=7114903d-465a-4ef6-b436-88af52261eae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:99:66,bridge_name='br-int',has_traffic_filtering=True,id=8bd721fc-ebab-49ab-9c7d-f900107b74b2,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd721fc-eb') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'pci_devices' on Instance uuid 7114903d-465a-4ef6-b436-88af52261eae {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:43:44 user nova-compute[72990]:   <uuid>7114903d-465a-4ef6-b436-88af52261eae</uuid>
Aug 27 03:43:44 user nova-compute[72990]:   <name>instance-0000000d</name>
Aug 27 03:43:44 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:43:44 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:43:44 user nova-compute[72990]:   <metadata>
Aug 27 03:43:44 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:43:44 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:43:44 user nova-compute[72990]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-334572128</nova:name>
Aug 27 03:43:44 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:43:43</nova:creationTime>
Aug 27 03:43:44 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:43:44 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:43:44 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:43:44 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:43:44 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:43:44 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:43:44 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:43:44 user nova-compute[72990]:       <nova:owner>
Aug 27 03:43:44 user nova-compute[72990]:         <nova:user uuid="858a63e8d5964f38ad776985cfbe9121">tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member</nova:user>
Aug 27 03:43:44 user nova-compute[72990]:         <nova:project uuid="183297ba5b6549fdb39f2135d92b3794">tempest-ServerBootFromVolumeStableRescueTest-1839224225</nova:project>
Aug 27 03:43:44 user nova-compute[72990]:       </nova:owner>
Aug 27 03:43:44 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:43:44 user nova-compute[72990]:       <nova:ports>
Aug 27 03:43:44 user nova-compute[72990]:         <nova:port uuid="8bd721fc-ebab-49ab-9c7d-f900107b74b2">
Aug 27 03:43:44 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 03:43:44 user nova-compute[72990]:         </nova:port>
Aug 27 03:43:44 user nova-compute[72990]:       </nova:ports>
Aug 27 03:43:44 user nova-compute[72990]:     </nova:instance>
Aug 27 03:43:44 user nova-compute[72990]:   </metadata>
Aug 27 03:43:44 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:43:44 user nova-compute[72990]:     <system>
Aug 27 03:43:44 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:43:44 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:43:44 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:43:44 user nova-compute[72990]:       <entry name="serial">7114903d-465a-4ef6-b436-88af52261eae</entry>
Aug 27 03:43:44 user nova-compute[72990]:       <entry name="uuid">7114903d-465a-4ef6-b436-88af52261eae</entry>
Aug 27 03:43:44 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:43:44 user nova-compute[72990]:     </system>
Aug 27 03:43:44 user nova-compute[72990]:   </sysinfo>
Aug 27 03:43:44 user nova-compute[72990]:   <os>
Aug 27 03:43:44 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:43:44 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:43:44 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:43:44 user nova-compute[72990]:   </os>
Aug 27 03:43:44 user nova-compute[72990]:   <features>
Aug 27 03:43:44 user nova-compute[72990]:     <acpi/>
Aug 27 03:43:44 user nova-compute[72990]:     <apic/>
Aug 27 03:43:44 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:43:44 user nova-compute[72990]:   </features>
Aug 27 03:43:44 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:43:44 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:43:44 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:43:44 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:43:44 user nova-compute[72990]:   </clock>
Aug 27 03:43:44 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:43:44 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:43:44 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:43:44 user nova-compute[72990]:   </cpu>
Aug 27 03:43:44 user nova-compute[72990]:   <devices>
Aug 27 03:43:44 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:43:44 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:43:44 user nova-compute[72990]:       <source dev="/dev/sdf"/>
Aug 27 03:43:44 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:43:44 user nova-compute[72990]:       <serial>22ce017c-edc6-4e54-bed5-792dc4e365f5</serial>
Aug 27 03:43:44 user nova-compute[72990]:     </disk>
Aug 27 03:43:44 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:43:44 user nova-compute[72990]:       <mac address="fa:16:3e:75:99:66"/>
Aug 27 03:43:44 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:43:44 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:43:44 user nova-compute[72990]:       <target dev="tap8bd721fc-eb"/>
Aug 27 03:43:44 user nova-compute[72990]:     </interface>
Aug 27 03:43:44 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:43:44 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/console.log" append="off"/>
Aug 27 03:43:44 user nova-compute[72990]:     </serial>
Aug 27 03:43:44 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:43:44 user nova-compute[72990]:     <video>
Aug 27 03:43:44 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:43:44 user nova-compute[72990]:     </video>
Aug 27 03:43:44 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:43:44 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:43:44 user nova-compute[72990]:     </rng>
Aug 27 03:43:44 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:43:44 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:43:44 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:43:44 user nova-compute[72990]:     </memballoon>
Aug 27 03:43:44 user nova-compute[72990]:   </devices>
Aug 27 03:43:44 user nova-compute[72990]: </domain>
Aug 27 03:43:44 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334572128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-334572128',id=13,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-qru8dfhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:43:24Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=7114903d-465a-4ef6-b436-88af52261eae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:99:66,bridge_name='br-int',has_traffic_filtering=True,id=8bd721fc-ebab-49ab-9c7d-f900107b74b2,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd721fc-eb') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG os_vif [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:99:66,bridge_name='br-int',has_traffic_filtering=True,id=8bd721fc-ebab-49ab-9c7d-f900107b74b2,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd721fc-eb') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bd721fc-eb, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8bd721fc-eb, col_values=(('external_ids', {'iface-id': '8bd721fc-ebab-49ab-9c7d-f900107b74b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:99:66', 'vm-uuid': '7114903d-465a-4ef6-b436-88af52261eae'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:44 user nova-compute[72990]: INFO os_vif [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:99:66,bridge_name='br-int',has_traffic_filtering=True,id=8bd721fc-ebab-49ab-9c7d-f900107b74b2,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd721fc-eb')
Aug 27 03:43:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:43:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No VIF found with MAC fa:16:3e:75:99:66, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:43:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-ae313d88-8701-4d10-8b41-1bff0aa786aa req-ffb51b6b-c92c-4f63-9a07-81cf1858063d service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ae313d88-8701-4d10-8b41-1bff0aa786aa req-ffb51b6b-c92c-4f63-9a07-81cf1858063d service nova] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ae313d88-8701-4d10-8b41-1bff0aa786aa req-ffb51b6b-c92c-4f63-9a07-81cf1858063d service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ae313d88-8701-4d10-8b41-1bff0aa786aa req-ffb51b6b-c92c-4f63-9a07-81cf1858063d service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-ae313d88-8701-4d10-8b41-1bff0aa786aa req-ffb51b6b-c92c-4f63-9a07-81cf1858063d service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] No waiting events found dispatching network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:46 user nova-compute[72990]: WARNING nova.compute.manager [req-ae313d88-8701-4d10-8b41-1bff0aa786aa req-ffb51b6b-c92c-4f63-9a07-81cf1858063d service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received unexpected event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 for instance with vm_state building and task_state spawning.
Aug 27 03:43:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107828.0628028, 7114903d-465a-4ef6-b436-88af52261eae => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:43:48 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] VM Resumed (Lifecycle Event)
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:43:48 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Instance spawned successfully.
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-790016d1-e24e-4eca-9489-b186d003e792 req-ac518483-38b7-4859-81b8-3363c6693744 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-790016d1-e24e-4eca-9489-b186d003e792 req-ac518483-38b7-4859-81b8-3363c6693744 service nova] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-790016d1-e24e-4eca-9489-b186d003e792 req-ac518483-38b7-4859-81b8-3363c6693744 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-790016d1-e24e-4eca-9489-b186d003e792 req-ac518483-38b7-4859-81b8-3363c6693744 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-790016d1-e24e-4eca-9489-b186d003e792 req-ac518483-38b7-4859-81b8-3363c6693744 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] No waiting events found dispatching network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:43:48 user nova-compute[72990]: WARNING nova.compute.manager [req-790016d1-e24e-4eca-9489-b186d003e792 req-ac518483-38b7-4859-81b8-3363c6693744 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received unexpected event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 for instance with vm_state building and task_state spawning.
Aug 27 03:43:48 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107828.0641139, 7114903d-465a-4ef6-b436-88af52261eae => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:43:48 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] VM Started (Lifecycle Event)
Aug 27 03:43:48 user nova-compute[72990]: INFO nova.compute.manager [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Took 5.14 seconds to spawn the instance on the hypervisor.
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:43:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:43:48 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:43:48 user nova-compute[72990]: INFO nova.compute.manager [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Took 25.63 seconds to build instance.
Aug 27 03:43:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f6b97f87-3722-45a7-9c31-835f39a9a742 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "7114903d-465a-4ef6-b436-88af52261eae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.779s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:43:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilpxscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a388d657-a11d-4a63-b7fc-2df799ca72d0', 'attached_at': '', 'detached_at': '', 'volume_id': '8e14715b-7629-40da-89fb-5982d92f42b7', 'serial': '8e14715b-7629-40da-89fb-5982d92f42b7'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYcmSVbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '412abe10-ac40-4fb2-ad36-8ac399108932'}, 'status': 'reserved', 'instance': 'a388d657-a11d-4a63-b7fc-2df799ca72d0', 'attached_at': '', 'detached_at': '', 'volume_id': '412abe10-ac40-4fb2-ad36-8ac399108932', 'serial'} {{(pid=72990) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilpxscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:54 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:54 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:54 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[76356d75-d10a-4e6f-959d-769713be2034]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:43:54 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4749ec-ffd1-4af8-874a-67db225f7393]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7] added
Aug 27 03:43:54 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5d301b-7cf3-484f-9950-0179b3195ee6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f2b8a-39d5-4834-9fab-bcd9a23065e9]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wilpxscQ {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wilpxscQ" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92afb11-b019-4ab3-bc2a-966a9bc9493c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wilpxscQ'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab7ddeb-f764-4e35-82c4-586ef1697fc9]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa1c072-fc68-437f-b0d5-9a83fd8de005]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fd80dd-637b-4756-9dc9-a7b31564ffd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260]
Aug 27 03:43:54 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:54 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8311c37-6c27-4033-81a7-c7b2f2555e10]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[349a6f24-4e85-470c-bfc5-7f00401aa855]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:54 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e006760a-4e3b-4d3e-8eee-96295e318e48]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilpxscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:43:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23536346161626134', 'path': '/dev/sdh'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536346161626134', 'path': '/dev/sdh'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:43:55 user nova-compute[72990]: DEBUG nova.objects.instance [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lazy-loading 'flavor' on Instance uuid a388d657-a11d-4a63-b7fc-2df799ca72d0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:43:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 118489088 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 228589568 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 389021696 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 591396864 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:58 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 768606208 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:58 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 967835648 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYcmSVbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '412abe10-ac40-4fb2-ad36-8ac399108932'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:43:59 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d2f8f1-758f-44f1-ac25-5aef786c761a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf2a3bb-dc1f-494b-ab4a-93be25546762]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:59 user nova-compute[72990]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:43:59 user nova-compute[72990]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:59 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:59 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:59 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:59 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 (non-flash)
Aug 27 03:43:59 user nova-compute[72990]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:43:59 user nova-compute[72990]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:43:59 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:43:59 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:43:59 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:43:59 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:43:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7236ff880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932'): ({'sdg'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Removing single pathed devices sdg {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e73f263-6f68-45a3-9b6c-c2de291ae26d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ba0c33-98b1-4015-bdd3-89b41fa84eda]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Flushing IO for device /dev/sdg {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[970991ba-2275-4e7f-8d14-d1b496cfaaed]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aec658e-b66e-4a5f-bcce-1f519444000b]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] SCSI volumes sdg have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a23604-14e3-493b-9611-43d526032395]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6387ef3b-228f-4d0f-9fd8-2c4a426444fe]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932, portal: 172.16.0.220,3260]
Aug 27 03:43:59 user nova-compute[72990]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932, portal: 172.16.0.220,3260] successful.
Aug 27 03:43:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:412abe10-ac40-4fb2-ad36-8ac399108932 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9512dfc0-e2a2-4910-a5e4-e452e7d11df0]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] <== disconnect_volume: return (309ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilpxscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'a388d657-a11d-4a63-b7fc-2df799ca72d0', 'attached_at': '', 'detached_at': '', 'volume_id': '8e14715b-7629-40da-89fb-5982d92f42b7', 'serial'} {{(pid=72990) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 27 03:43:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] swap_volume: removing Cinder connection for volume 412abe10-ac40-4fb2-ad36-8ac399108932 {{(pid=72990) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 27 03:44:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] swap_volume: Updating volume 412abe10-ac40-4fb2-ad36-8ac399108932 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "wilpxscQ", "auth_password": "G7XJcBI2O6nkEb", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "8e14715b-7629-40da-89fb-5982d92f42b7"}, "status": "reserved", "instance": "a388d657-a11d-4a63-b7fc-2df799ca72d0", "attached_at": "", "detached_at": "", "volume_id": "8e14715b-7629-40da-89fb-5982d92f42b7", "serial": "8e14715b-7629-40da-89fb-5982d92f42b7"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '8e14715b-7629-40da-89fb-5982d92f42b7', 'no_device': None, 'attachment_id': '568513ee-0dcd-4399-8c86-a7b59f31b3c4'} {{(pid=72990) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 27 03:44:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cb2e60bd-2263-4ebe-8a0d-7625d09c0360 tempest-TestVolumeSwap-575677769 tempest-TestVolumeSwap-575677769-project-admin] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.278s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:02 user nova-compute[72990]: INFO nova.compute.manager [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Detaching volume 8e14715b-7629-40da-89fb-5982d92f42b7
Aug 27 03:44:02 user nova-compute[72990]: INFO nova.virt.block_device [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Attempting to driver detach volume 8e14715b-7629-40da-89fb-5982d92f42b7 from mountpoint /dev/vdb
Aug 27 03:44:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Attempting to detach device vdb from instance a388d657-a11d-4a63-b7fc-2df799ca72d0 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:44:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:44:02 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:44:02 user nova-compute[72990]:   <source dev="/dev/sdh"/>
Aug 27 03:44:02 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:44:02 user nova-compute[72990]:   <serial>8e14715b-7629-40da-89fb-5982d92f42b7</serial>
Aug 27 03:44:02 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:44:02 user nova-compute[72990]: </disk>
Aug 27 03:44:02 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:44:02 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Successfully detached device vdb from instance a388d657-a11d-4a63-b7fc-2df799ca72d0 from the persistent domain config.
Aug 27 03:44:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a388d657-a11d-4a63-b7fc-2df799ca72d0 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:44:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:44:02 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:44:02 user nova-compute[72990]:   <source dev="/dev/sdh"/>
Aug 27 03:44:02 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:44:02 user nova-compute[72990]:   <serial>8e14715b-7629-40da-89fb-5982d92f42b7</serial>
Aug 27 03:44:02 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:44:02 user nova-compute[72990]: </disk>
Aug 27 03:44:02 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693107843.004947, a388d657-a11d-4a63-b7fc-2df799ca72d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a388d657-a11d-4a63-b7fc-2df799ca72d0 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:44:03 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Successfully detached device vdb from instance a388d657-a11d-4a63-b7fc-2df799ca72d0 from the live domain config.
Aug 27 03:44:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilpxscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '8e14715b-7629-40da-89fb-5982d92f42b7'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:44:03 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66a3732-a86e-4413-ac52-719a46188de8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6816eb68-77b4-4776-875f-cb50cab5f255]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:44:03 user nova-compute[72990]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:44:03 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:44:03 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:44:03 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:44:03 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:44:03 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:44:03 user nova-compute[72990]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 (non-flash)
Aug 27 03:44:03 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:44:03 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:44:03 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:44:03 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:44:03 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4431630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7'): ({'sdh'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Removing single pathed devices sdh {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e292ee-30e9-4ba6-bc2a-9889409d47bf]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a352f4-1f30-4e5c-bd57-66422671dbfc]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Flushing IO for device /dev/sdh {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadc0d7d-837a-45be-960c-7e60710e2edd]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[21098bb3-7c34-4f38-9e27-0930c848496e]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] SCSI volumes sdh have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e935e8b-0fee-4463-8ca7-6a42542c11fc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad8a441-0592-4583-8b1e-72525f19800a]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260]
Aug 27 03:44:03 user nova-compute[72990]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7, portal: 172.16.0.220,3260] successful.
Aug 27 03:44:03 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e14715b-7629-40da-89fb-5982d92f42b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedd7b62-6928-4292-866b-046278f1b77a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] <== disconnect_volume: return (289ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:44:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:44:04 user nova-compute[72990]: DEBUG nova.objects.instance [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lazy-loading 'flavor' on Instance uuid a388d657-a11d-4a63-b7fc-2df799ca72d0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d2f7d28b-5311-43f0-ae5b-6b99faf464bd tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.650s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:44:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:44:07 user nova-compute[72990]: INFO nova.compute.claims [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Claim successful on node user
Aug 27 03:44:07 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:44:07 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:44:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:44:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:44:07 user nova-compute[72990]: DEBUG nova.network.neutron [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:44:07 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:44:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:44:07 user nova-compute[72990]: DEBUG nova.policy [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70e76f4237f8491da1a1003787625936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8ee9d65a3449cc8793fe94beb962b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG nova.compute.manager [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:44:08 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Creating image(s)
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "/opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "/opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "/opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.208s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk 1073741824" returned: 0 in 0.069s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG nova.network.neutron [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Successfully created port: b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Cannot resize image /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Ensure instance console log exists: /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.network.neutron [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Successfully updated port: b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "refresh_cache-fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquired lock "refresh_cache-fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.network.neutron [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-2ff4a9ce-776d-402e-8513-06ed8ee852c6 req-51b74fdf-d96d-4584-abce-c4e559ed727b service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Received event network-changed-b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-2ff4a9ce-776d-402e-8513-06ed8ee852c6 req-51b74fdf-d96d-4584-abce-c4e559ed727b service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Refreshing instance network info cache due to event network-changed-b4c472fe-263f-4cbf-8f0a-67b47d6509fb. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2ff4a9ce-776d-402e-8513-06ed8ee852c6 req-51b74fdf-d96d-4584-abce-c4e559ed727b service nova] Acquiring lock "refresh_cache-fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.network.neutron [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.network.neutron [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Updating instance_info_cache with network_info: [{"id": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "address": "fa:16:3e:11:17:25", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c472fe-26", "ovs_interfaceid": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Releasing lock "refresh_cache-fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.compute.manager [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Instance network_info: |[{"id": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "address": "fa:16:3e:11:17:25", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c472fe-26", "ovs_interfaceid": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2ff4a9ce-776d-402e-8513-06ed8ee852c6 req-51b74fdf-d96d-4584-abce-c4e559ed727b service nova] Acquired lock "refresh_cache-fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.network.neutron [req-2ff4a9ce-776d-402e-8513-06ed8ee852c6 req-51b74fdf-d96d-4584-abce-c4e559ed727b service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Refreshing network info cache for port b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Start _get_guest_xml network_info=[{"id": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "address": "fa:16:3e:11:17:25", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c472fe-26", "ovs_interfaceid": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:44:09 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:44:09 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:44:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1243667798',display_name='tempest-VolumesAdminNegativeTest-server-1243667798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1243667798',id=14,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c8ee9d65a3449cc8793fe94beb962b9',ramdisk_id='',reservation_id='r-w759omxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1331051968',owner_user_name='tempest-VolumesAdminNegativeTest-1331051968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:44:08Z,user_data=None,user_id='70e76f4237f8491da1a1003787625936',uuid=fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "address": "fa:16:3e:11:17:25", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c472fe-26", "ovs_interfaceid": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Converting VIF {"id": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "address": "fa:16:3e:11:17:25", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c472fe-26", "ovs_interfaceid": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:25,bridge_name='br-int',has_traffic_filtering=True,id=b4c472fe-263f-4cbf-8f0a-67b47d6509fb,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c472fe-26') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.objects.instance [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lazy-loading 'pci_devices' on Instance uuid fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:44:09 user nova-compute[72990]:   <uuid>fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31</uuid>
Aug 27 03:44:09 user nova-compute[72990]:   <name>instance-0000000e</name>
Aug 27 03:44:09 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:44:09 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:44:09 user nova-compute[72990]:   <metadata>
Aug 27 03:44:09 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:44:09 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:44:09 user nova-compute[72990]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1243667798</nova:name>
Aug 27 03:44:09 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:44:09</nova:creationTime>
Aug 27 03:44:09 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:44:09 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:44:09 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:44:09 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:44:09 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:44:09 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:44:09 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:44:09 user nova-compute[72990]:       <nova:owner>
Aug 27 03:44:09 user nova-compute[72990]:         <nova:user uuid="70e76f4237f8491da1a1003787625936">tempest-VolumesAdminNegativeTest-1331051968-project-member</nova:user>
Aug 27 03:44:09 user nova-compute[72990]:         <nova:project uuid="0c8ee9d65a3449cc8793fe94beb962b9">tempest-VolumesAdminNegativeTest-1331051968</nova:project>
Aug 27 03:44:09 user nova-compute[72990]:       </nova:owner>
Aug 27 03:44:09 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:44:09 user nova-compute[72990]:       <nova:ports>
Aug 27 03:44:09 user nova-compute[72990]:         <nova:port uuid="b4c472fe-263f-4cbf-8f0a-67b47d6509fb">
Aug 27 03:44:09 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 03:44:09 user nova-compute[72990]:         </nova:port>
Aug 27 03:44:09 user nova-compute[72990]:       </nova:ports>
Aug 27 03:44:09 user nova-compute[72990]:     </nova:instance>
Aug 27 03:44:09 user nova-compute[72990]:   </metadata>
Aug 27 03:44:09 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:44:09 user nova-compute[72990]:     <system>
Aug 27 03:44:09 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:44:09 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:44:09 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:44:09 user nova-compute[72990]:       <entry name="serial">fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31</entry>
Aug 27 03:44:09 user nova-compute[72990]:       <entry name="uuid">fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31</entry>
Aug 27 03:44:09 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:44:09 user nova-compute[72990]:     </system>
Aug 27 03:44:09 user nova-compute[72990]:   </sysinfo>
Aug 27 03:44:09 user nova-compute[72990]:   <os>
Aug 27 03:44:09 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:44:09 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:44:09 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:44:09 user nova-compute[72990]:   </os>
Aug 27 03:44:09 user nova-compute[72990]:   <features>
Aug 27 03:44:09 user nova-compute[72990]:     <acpi/>
Aug 27 03:44:09 user nova-compute[72990]:     <apic/>
Aug 27 03:44:09 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:44:09 user nova-compute[72990]:   </features>
Aug 27 03:44:09 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:44:09 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:44:09 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:44:09 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:44:09 user nova-compute[72990]:   </clock>
Aug 27 03:44:09 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:44:09 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:44:09 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:44:09 user nova-compute[72990]:   </cpu>
Aug 27 03:44:09 user nova-compute[72990]:   <devices>
Aug 27 03:44:09 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:44:09 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:44:09 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk"/>
Aug 27 03:44:09 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:44:09 user nova-compute[72990]:     </disk>
Aug 27 03:44:09 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:44:09 user nova-compute[72990]:       <mac address="fa:16:3e:11:17:25"/>
Aug 27 03:44:09 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:44:09 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:44:09 user nova-compute[72990]:       <target dev="tapb4c472fe-26"/>
Aug 27 03:44:09 user nova-compute[72990]:     </interface>
Aug 27 03:44:09 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:44:09 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/console.log" append="off"/>
Aug 27 03:44:09 user nova-compute[72990]:     </serial>
Aug 27 03:44:09 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:44:09 user nova-compute[72990]:     <video>
Aug 27 03:44:09 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:44:09 user nova-compute[72990]:     </video>
Aug 27 03:44:09 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:44:09 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:44:09 user nova-compute[72990]:     </rng>
Aug 27 03:44:09 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:44:09 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:44:09 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:44:09 user nova-compute[72990]:     </memballoon>
Aug 27 03:44:09 user nova-compute[72990]:   </devices>
Aug 27 03:44:09 user nova-compute[72990]: </domain>
Aug 27 03:44:09 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:44:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1243667798',display_name='tempest-VolumesAdminNegativeTest-server-1243667798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1243667798',id=14,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c8ee9d65a3449cc8793fe94beb962b9',ramdisk_id='',reservation_id='r-w759omxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1331051968',owner_user_name='tempest-VolumesAdminNegativeTest-1331051968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:44:08Z,user_data=None,user_id='70e76f4237f8491da1a1003787625936',uuid=fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "address": "fa:16:3e:11:17:25", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c472fe-26", "ovs_interfaceid": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Converting VIF {"id": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "address": "fa:16:3e:11:17:25", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c472fe-26", "ovs_interfaceid": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:25,bridge_name='br-int',has_traffic_filtering=True,id=b4c472fe-263f-4cbf-8f0a-67b47d6509fb,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c472fe-26') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG os_vif [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:25,bridge_name='br-int',has_traffic_filtering=True,id=b4c472fe-263f-4cbf-8f0a-67b47d6509fb,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c472fe-26') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4c472fe-26, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4c472fe-26, col_values=(('external_ids', {'iface-id': 'b4c472fe-263f-4cbf-8f0a-67b47d6509fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:17:25', 'vm-uuid': 'fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:09 user nova-compute[72990]: INFO os_vif [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:25,bridge_name='br-int',has_traffic_filtering=True,id=b4c472fe-263f-4cbf-8f0a-67b47d6509fb,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c472fe-26')
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:44:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] No VIF found with MAC fa:16:3e:11:17:25, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:44:10 user nova-compute[72990]: DEBUG nova.network.neutron [req-2ff4a9ce-776d-402e-8513-06ed8ee852c6 req-51b74fdf-d96d-4584-abce-c4e559ed727b service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Updated VIF entry in instance network info cache for port b4c472fe-263f-4cbf-8f0a-67b47d6509fb. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:44:10 user nova-compute[72990]: DEBUG nova.network.neutron [req-2ff4a9ce-776d-402e-8513-06ed8ee852c6 req-51b74fdf-d96d-4584-abce-c4e559ed727b service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Updating instance_info_cache with network_info: [{"id": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "address": "fa:16:3e:11:17:25", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c472fe-26", "ovs_interfaceid": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2ff4a9ce-776d-402e-8513-06ed8ee852c6 req-51b74fdf-d96d-4584-abce-c4e559ed727b service nova] Releasing lock "refresh_cache-fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:44:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-f28c3315-bb05-48e3-b18e-d4868f79dde0 req-142de87a-f244-49ac-8a45-e9116ae728d5 service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Received event network-vif-plugged-b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f28c3315-bb05-48e3-b18e-d4868f79dde0 req-142de87a-f244-49ac-8a45-e9116ae728d5 service nova] Acquiring lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f28c3315-bb05-48e3-b18e-d4868f79dde0 req-142de87a-f244-49ac-8a45-e9116ae728d5 service nova] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f28c3315-bb05-48e3-b18e-d4868f79dde0 req-142de87a-f244-49ac-8a45-e9116ae728d5 service nova] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-f28c3315-bb05-48e3-b18e-d4868f79dde0 req-142de87a-f244-49ac-8a45-e9116ae728d5 service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] No waiting events found dispatching network-vif-plugged-b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:11 user nova-compute[72990]: WARNING nova.compute.manager [req-f28c3315-bb05-48e3-b18e-d4868f79dde0 req-142de87a-f244-49ac-8a45-e9116ae728d5 service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Received unexpected event network-vif-plugged-b4c472fe-263f-4cbf-8f0a-67b47d6509fb for instance with vm_state building and task_state spawning.
Aug 27 03:44:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107853.340321, fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:44:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] VM Resumed (Lifecycle Event)
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:44:13 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Instance spawned successfully.
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107853.3437023, fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:44:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] VM Started (Lifecycle Event)
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:44:13 user nova-compute[72990]: INFO nova.compute.manager [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Took 5.43 seconds to spawn the instance on the hypervisor.
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-f98c9aac-4940-4d5c-b007-1d830a47e4f8 req-2493712a-ec8a-4142-b27a-68075ae13cf3 service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Received event network-vif-plugged-b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f98c9aac-4940-4d5c-b007-1d830a47e4f8 req-2493712a-ec8a-4142-b27a-68075ae13cf3 service nova] Acquiring lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f98c9aac-4940-4d5c-b007-1d830a47e4f8 req-2493712a-ec8a-4142-b27a-68075ae13cf3 service nova] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f98c9aac-4940-4d5c-b007-1d830a47e4f8 req-2493712a-ec8a-4142-b27a-68075ae13cf3 service nova] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-f98c9aac-4940-4d5c-b007-1d830a47e4f8 req-2493712a-ec8a-4142-b27a-68075ae13cf3 service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] No waiting events found dispatching network-vif-plugged-b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:13 user nova-compute[72990]: WARNING nova.compute.manager [req-f98c9aac-4940-4d5c-b007-1d830a47e4f8 req-2493712a-ec8a-4142-b27a-68075ae13cf3 service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Received unexpected event network-vif-plugged-b4c472fe-263f-4cbf-8f0a-67b47d6509fb for instance with vm_state building and task_state spawning.
Aug 27 03:44:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:44:13 user nova-compute[72990]: INFO nova.compute.manager [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Took 6.42 seconds to build instance.
Aug 27 03:44:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec52aed-8d96-4c3c-84c1-5a79360a27cc tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.507s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:17 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:44:19 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:44:19 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:44:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "7835f781-b543-4370-922b-3d2a76f9821b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:19 user nova-compute[72990]: DEBUG nova.objects.instance [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lazy-loading 'flavor' on Instance uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "7835f781-b543-4370-922b-3d2a76f9821b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "7835f781-b543-4370-922b-3d2a76f9821b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:19 user nova-compute[72990]: INFO nova.compute.manager [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Attaching volume 0dc5c32f-6b98-4193-800d-09f5c79731ab to /dev/vdb
Aug 27 03:44:20 user nova-compute[72990]: DEBUG os_brick.utils [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a118fe8-9db7-4c9f-b929-0d26a9278964]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32d528a-57c0-4e8e-8b03-ad8c48e85d73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eec9d5a-a7bc-4531-a956-f3888f1f2025]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2792d98-304e-4a8a-805f-354d017ce493]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:44:20 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6912e73f-4e6c-4438-a97e-350e1e09328b]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG os_brick.utils [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating existing volume attachment record: d3c19581-b09d-4b5d-a744-d85b146a4683 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:44:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:21 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:44:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:21 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:44:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:44:25 user nova-compute[72990]: INFO nova.compute.claims [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Claim successful on node user
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.722s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:44:26 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG nova.policy [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb95e31732904174a8ebddf48c6426ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2282ed15ca724f029c368c8a5ce0f268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:44:26 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Creating image(s)
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "/opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "/opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.229s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.180s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk 1073741824" returned: 0 in 0.070s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.857s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:28 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:44:28 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7029MB free_disk=25.471221923828125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Cannot resize image /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Ensure instance console log exists: /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bc82cced-9f16-44bc-b9bc-622fa99b1be0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bbab26b4-9515-4427-a01c-04f4a85b1fa8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ed1742b9-a19d-43f9-b39a-7257261f858c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 970ca110-30d7-4e41-92d3-aa4e0bda4482 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance e4842b80-80e8-4df9-a4bb-30529de4a013 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance a388d657-a11d-4a63-b7fc-2df799ca72d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Successfully created port: 9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:44:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Successfully updated port: 9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "refresh_cache-ed1742b9-a19d-43f9-b39a-7257261f858c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquired lock "refresh_cache-ed1742b9-a19d-43f9-b39a-7257261f858c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-b5b815fa-7abe-4f26-a989-e2a64f0af554 req-3714c7c7-65d4-4b3f-9802-9b99400e8f9f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received event network-changed-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-b5b815fa-7abe-4f26-a989-e2a64f0af554 req-3714c7c7-65d4-4b3f-9802-9b99400e8f9f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Refreshing instance network info cache due to event network-changed-9e575e22-6f02-488a-8e18-e9675c3b96ab. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b5b815fa-7abe-4f26-a989-e2a64f0af554 req-3714c7c7-65d4-4b3f-9802-9b99400e8f9f service nova] Acquiring lock "refresh_cache-ed1742b9-a19d-43f9-b39a-7257261f858c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Acquiring lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Acquiring lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:30 user nova-compute[72990]: INFO nova.compute.manager [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Terminating instance
Aug 27 03:44:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:44:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Updating instance_info_cache with network_info: [{"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Releasing lock "refresh_cache-ed1742b9-a19d-43f9-b39a-7257261f858c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Instance network_info: |[{"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b5b815fa-7abe-4f26-a989-e2a64f0af554 req-3714c7c7-65d4-4b3f-9802-9b99400e8f9f service nova] Acquired lock "refresh_cache-ed1742b9-a19d-43f9-b39a-7257261f858c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.network.neutron [req-b5b815fa-7abe-4f26-a989-e2a64f0af554 req-3714c7c7-65d4-4b3f-9802-9b99400e8f9f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Refreshing network info cache for port 9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Start _get_guest_xml network_info=[{"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:44:31 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:44:31 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1281588218',display_name='tempest-tempest.common.compute-instance-1281588218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1281588218',id=15,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlsSoCaAZImkchManu4IUvMInuwySyWjvM2BnRYj8TwOTjrbfVvrIsy0gRdvaW2QKnHoTyZTaBdUMPbi7bSwOX2IM8E9MHYP+B14NgLPuI0yP5eDhmXA6u6V49C6mCNCw==',key_name='tempest-keypair-67383262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-07ekxxya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=ed1742b9-a19d-43f9-b39a-7257261f858c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lazy-loading 'pci_devices' on Instance uuid ed1742b9-a19d-43f9-b39a-7257261f858c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:44:31 user nova-compute[72990]:   <uuid>ed1742b9-a19d-43f9-b39a-7257261f858c</uuid>
Aug 27 03:44:31 user nova-compute[72990]:   <name>instance-0000000f</name>
Aug 27 03:44:31 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:44:31 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:44:31 user nova-compute[72990]:   <metadata>
Aug 27 03:44:31 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:44:31 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:44:31 user nova-compute[72990]:       <nova:name>tempest-tempest.common.compute-instance-1281588218</nova:name>
Aug 27 03:44:31 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:44:31</nova:creationTime>
Aug 27 03:44:31 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:44:31 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:44:31 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:44:31 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:44:31 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:44:31 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:44:31 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:44:31 user nova-compute[72990]:       <nova:owner>
Aug 27 03:44:31 user nova-compute[72990]:         <nova:user uuid="cb95e31732904174a8ebddf48c6426ed">tempest-ServerActionsTestOtherA-938526966-project-member</nova:user>
Aug 27 03:44:31 user nova-compute[72990]:         <nova:project uuid="2282ed15ca724f029c368c8a5ce0f268">tempest-ServerActionsTestOtherA-938526966</nova:project>
Aug 27 03:44:31 user nova-compute[72990]:       </nova:owner>
Aug 27 03:44:31 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:44:31 user nova-compute[72990]:       <nova:ports>
Aug 27 03:44:31 user nova-compute[72990]:         <nova:port uuid="9e575e22-6f02-488a-8e18-e9675c3b96ab">
Aug 27 03:44:31 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 03:44:31 user nova-compute[72990]:         </nova:port>
Aug 27 03:44:31 user nova-compute[72990]:       </nova:ports>
Aug 27 03:44:31 user nova-compute[72990]:     </nova:instance>
Aug 27 03:44:31 user nova-compute[72990]:   </metadata>
Aug 27 03:44:31 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:44:31 user nova-compute[72990]:     <system>
Aug 27 03:44:31 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:44:31 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:44:31 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:44:31 user nova-compute[72990]:       <entry name="serial">ed1742b9-a19d-43f9-b39a-7257261f858c</entry>
Aug 27 03:44:31 user nova-compute[72990]:       <entry name="uuid">ed1742b9-a19d-43f9-b39a-7257261f858c</entry>
Aug 27 03:44:31 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:44:31 user nova-compute[72990]:     </system>
Aug 27 03:44:31 user nova-compute[72990]:   </sysinfo>
Aug 27 03:44:31 user nova-compute[72990]:   <os>
Aug 27 03:44:31 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:44:31 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:44:31 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:44:31 user nova-compute[72990]:   </os>
Aug 27 03:44:31 user nova-compute[72990]:   <features>
Aug 27 03:44:31 user nova-compute[72990]:     <acpi/>
Aug 27 03:44:31 user nova-compute[72990]:     <apic/>
Aug 27 03:44:31 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:44:31 user nova-compute[72990]:   </features>
Aug 27 03:44:31 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:44:31 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:44:31 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:44:31 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:44:31 user nova-compute[72990]:   </clock>
Aug 27 03:44:31 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:44:31 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:44:31 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:44:31 user nova-compute[72990]:   </cpu>
Aug 27 03:44:31 user nova-compute[72990]:   <devices>
Aug 27 03:44:31 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:44:31 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:44:31 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk"/>
Aug 27 03:44:31 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:44:31 user nova-compute[72990]:     </disk>
Aug 27 03:44:31 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:44:31 user nova-compute[72990]:       <mac address="fa:16:3e:07:eb:d3"/>
Aug 27 03:44:31 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:44:31 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:44:31 user nova-compute[72990]:       <target dev="tap9e575e22-6f"/>
Aug 27 03:44:31 user nova-compute[72990]:     </interface>
Aug 27 03:44:31 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:44:31 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/console.log" append="off"/>
Aug 27 03:44:31 user nova-compute[72990]:     </serial>
Aug 27 03:44:31 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:44:31 user nova-compute[72990]:     <video>
Aug 27 03:44:31 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:44:31 user nova-compute[72990]:     </video>
Aug 27 03:44:31 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:44:31 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:44:31 user nova-compute[72990]:     </rng>
Aug 27 03:44:31 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:44:31 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:44:31 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:44:31 user nova-compute[72990]:     </memballoon>
Aug 27 03:44:31 user nova-compute[72990]:   </devices>
Aug 27 03:44:31 user nova-compute[72990]: </domain>
Aug 27 03:44:31 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1281588218',display_name='tempest-tempest.common.compute-instance-1281588218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1281588218',id=15,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlsSoCaAZImkchManu4IUvMInuwySyWjvM2BnRYj8TwOTjrbfVvrIsy0gRdvaW2QKnHoTyZTaBdUMPbi7bSwOX2IM8E9MHYP+B14NgLPuI0yP5eDhmXA6u6V49C6mCNCw==',key_name='tempest-keypair-67383262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-07ekxxya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=ed1742b9-a19d-43f9-b39a-7257261f858c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG os_vif [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e575e22-6f, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e575e22-6f, col_values=(('external_ids', {'iface-id': '9e575e22-6f02-488a-8e18-e9675c3b96ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:eb:d3', 'vm-uuid': 'ed1742b9-a19d-43f9-b39a-7257261f858c'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:31 user nova-compute[72990]: INFO os_vif [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f')
Aug 27 03:44:31 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Instance destroyed successfully.
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.objects.instance [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lazy-loading 'resources' on Instance uuid a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1468368321',display_name='tempest-VolumesAssistedSnapshotsTest-server-1468368321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1468368321',id=10,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoq63sBKCN7VC2v5UiTw0Sj3REf1W80UyKZckQWDC7NAXd1AsGs9h4dQSTavtTHMQBtWPAHgaHEdhy99dxCDybKZ44vfFYJFi0tz1Nbs9wqSBfbwE5I/K97NVLH6xrwZw==',key_name='tempest-keypair-1884002227',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:41:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc61380783bd4439a0f3205d0e5cfa1c',ramdisk_id='',reservation_id='r-1m5xovf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-683201497',owner_user_name='tempest-VolumesAssistedSnapshotsTest-683201497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a99be1360244389ae77eaf6fc5249ed',uuid=a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75916180-ab9a-4930-9c30-b2b67b3284d3", "address": "fa:16:3e:ca:eb:1e", "network": {"id": "681b81c3-eae5-44a6-8cc5-f75f95fd1a40", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1610213912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc61380783bd4439a0f3205d0e5cfa1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75916180-ab", "ovs_interfaceid": "75916180-ab9a-4930-9c30-b2b67b3284d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Converting VIF {"id": "75916180-ab9a-4930-9c30-b2b67b3284d3", "address": "fa:16:3e:ca:eb:1e", "network": {"id": "681b81c3-eae5-44a6-8cc5-f75f95fd1a40", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1610213912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc61380783bd4439a0f3205d0e5cfa1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75916180-ab", "ovs_interfaceid": "75916180-ab9a-4930-9c30-b2b67b3284d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:eb:1e,bridge_name='br-int',has_traffic_filtering=True,id=75916180-ab9a-4930-9c30-b2b67b3284d3,network=Network(681b81c3-eae5-44a6-8cc5-f75f95fd1a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75916180-ab') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG os_vif [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:eb:1e,bridge_name='br-int',has_traffic_filtering=True,id=75916180-ab9a-4930-9c30-b2b67b3284d3,network=Network(681b81c3-eae5-44a6-8cc5-f75f95fd1a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75916180-ab') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75916180-ab, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:31 user nova-compute[72990]: INFO os_vif [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:eb:1e,bridge_name='br-int',has_traffic_filtering=True,id=75916180-ab9a-4930-9c30-b2b67b3284d3,network=Network(681b81c3-eae5-44a6-8cc5-f75f95fd1a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75916180-ab')
Aug 27 03:44:31 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Deleting instance files /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63_del
Aug 27 03:44:31 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Deletion of /opt/stack/data/nova/instances/a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63_del complete
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No VIF found with MAC fa:16:3e:07:eb:d3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:44:31 user nova-compute[72990]: INFO nova.compute.manager [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 27 03:44:31 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:44:31 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:44:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-b5b815fa-7abe-4f26-a989-e2a64f0af554 req-3714c7c7-65d4-4b3f-9802-9b99400e8f9f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Updated VIF entry in instance network info cache for port 9e575e22-6f02-488a-8e18-e9675c3b96ab. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-b5b815fa-7abe-4f26-a989-e2a64f0af554 req-3714c7c7-65d4-4b3f-9802-9b99400e8f9f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Updating instance_info_cache with network_info: [{"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b5b815fa-7abe-4f26-a989-e2a64f0af554 req-3714c7c7-65d4-4b3f-9802-9b99400e8f9f service nova] Releasing lock "refresh_cache-ed1742b9-a19d-43f9-b39a-7257261f858c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-3d437345-b10b-4049-b7c2-6321cce0532b req-4b240aaa-ecdf-4236-99fe-2a4c5d80191b service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Received event network-vif-unplugged-75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3d437345-b10b-4049-b7c2-6321cce0532b req-4b240aaa-ecdf-4236-99fe-2a4c5d80191b service nova] Acquiring lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3d437345-b10b-4049-b7c2-6321cce0532b req-4b240aaa-ecdf-4236-99fe-2a4c5d80191b service nova] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3d437345-b10b-4049-b7c2-6321cce0532b req-4b240aaa-ecdf-4236-99fe-2a4c5d80191b service nova] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-3d437345-b10b-4049-b7c2-6321cce0532b req-4b240aaa-ecdf-4236-99fe-2a4c5d80191b service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] No waiting events found dispatching network-vif-unplugged-75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-3d437345-b10b-4049-b7c2-6321cce0532b req-4b240aaa-ecdf-4236-99fe-2a4c5d80191b service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Received event network-vif-unplugged-75916180-ab9a-4930-9c30-b2b67b3284d3 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-a055f09e-3052-48b3-a7ce-5b1b7f6173d3 req-c1e532ae-ac54-431f-91d9-5ce62d712825 service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Received event network-vif-deleted-75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:34 user nova-compute[72990]: INFO nova.compute.manager [req-a055f09e-3052-48b3-a7ce-5b1b7f6173d3 req-c1e532ae-ac54-431f-91d9-5ce62d712825 service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Neutron deleted interface 75916180-ab9a-4930-9c30-b2b67b3284d3; detaching it from the instance and deleting it from the info cache
Aug 27 03:44:34 user nova-compute[72990]: DEBUG nova.network.neutron [req-a055f09e-3052-48b3-a7ce-5b1b7f6173d3 req-c1e532ae-ac54-431f-91d9-5ce62d712825 service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:34 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Took 2.55 seconds to deallocate network for instance.
Aug 27 03:44:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-a055f09e-3052-48b3-a7ce-5b1b7f6173d3 req-c1e532ae-ac54-431f-91d9-5ce62d712825 service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Detach interface failed, port_id=75916180-ab9a-4930-9c30-b2b67b3284d3, reason: Instance a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAaSEuhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:44:34 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:44:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:44:34 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:44:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:44:34 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ef9cda-1293-4d1b-aba6-2fb0a4b276de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:44:34 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5b5be2-ef1a-4ad8-9506-0b250fdb6176]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab] added
Aug 27 03:44:34 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67371fc-abc1-4e19-8305-b40586fbd22f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8341c165-6438-4db0-aed5-74928f9b1934]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KAaSEuhj {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KAaSEuhj" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[924f0ad6-685e-4647-902d-b0c523728d6f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KAaSEuhj'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[53996dcc-2546-451a-bcbd-5b6fa7d0f19a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.698s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f7b102-c016-487c-833a-dadc20d403ef]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:35 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Deleted allocations for instance a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1bb5f5-5ec2-4f13-ad9c-e7823c1d5ccb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab, portal: 172.16.0.220,3260]
Aug 27 03:44:35 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab, portal: 172.16.0.220,3260] successful.
Aug 27 03:44:35 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e355e42-c6c6-484d-8c51-f12e4da74023]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f75a60-d9d8-4fae-ba23-cf50c5907785]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:44:35 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] HCTL ('38', '-', '-', 0) found on session 13 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0955064d-6d78-493b-a9f0-aa38ee56910f]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAaSEuhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-883d9bda-3df0-4885-b182-f1f664a3aef6 tempest-VolumesAssistedSnapshotsTest-683201497 tempest-VolumesAssistedSnapshotsTest-683201497-project-member] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.559s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG nova.compute.manager [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Received event network-vif-plugged-75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] Acquiring lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] Lock "a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG nova.compute.manager [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] No waiting events found dispatching network-vif-plugged-75916180-ab9a-4930-9c30-b2b67b3284d3 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:35 user nova-compute[72990]: WARNING nova.compute.manager [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Received unexpected event network-vif-plugged-75916180-ab9a-4930-9c30-b2b67b3284d3 for instance with vm_state deleted and task_state None.
Aug 27 03:44:35 user nova-compute[72990]: DEBUG nova.compute.manager [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received event network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG nova.compute.manager [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] No waiting events found dispatching network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:35 user nova-compute[72990]: WARNING nova.compute.manager [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received unexpected event network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab for instance with vm_state building and task_state spawning.
Aug 27 03:44:35 user nova-compute[72990]: DEBUG nova.compute.manager [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received event network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:35 user nova-compute[72990]: DEBUG nova.compute.manager [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] No waiting events found dispatching network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:35 user nova-compute[72990]: WARNING nova.compute.manager [req-1be823a7-c075-447a-8c63-ac5b39f1af98 req-12400116-2764-41b5-986c-66b888178ede service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received unexpected event network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab for instance with vm_state building and task_state spawning.
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107876.0582457, ed1742b9-a19d-43f9-b39a-7257261f858c => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:44:36 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] VM Resumed (Lifecycle Event)
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:44:36 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Instance spawned successfully.
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:44:36 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107876.059734, ed1742b9-a19d-43f9-b39a-7257261f858c => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:44:36 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] VM Started (Lifecycle Event)
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:44:36 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:44:36 user nova-compute[72990]: INFO nova.compute.manager [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Took 9.30 seconds to spawn the instance on the hypervisor.
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26161373538653931', 'path': '/dev/sdg'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161373538653931', 'path': '/dev/sdg'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.objects.instance [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lazy-loading 'flavor' on Instance uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:44:36 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:44:36 user nova-compute[72990]:   <source dev="/dev/sdg"/>
Aug 27 03:44:36 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:44:36 user nova-compute[72990]:   <serial>0dc5c32f-6b98-4193-800d-09f5c79731ab</serial>
Aug 27 03:44:36 user nova-compute[72990]: </disk>
Aug 27 03:44:36 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:44:36 user nova-compute[72990]: INFO nova.compute.manager [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Took 10.69 seconds to build instance.
Aug 27 03:44:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dd51c22f-6c33-41e8-a5ea-20eb8f42ef7a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.859s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:44:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] No VIF found with MAC fa:16:3e:1c:62:6e, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:44:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6a2245e3-3fa4-4dea-8454-02aa6d2bc635 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "7835f781-b543-4370-922b-3d2a76f9821b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.066s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:38 user nova-compute[72990]: INFO nova.compute.manager [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Rescuing
Aug 27 03:44:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:44:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquired lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:44:38 user nova-compute[72990]: DEBUG nova.network.neutron [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:44:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:44:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:44:38 user nova-compute[72990]: INFO nova.compute.claims [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Claim successful on node user
Aug 27 03:44:39 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Releasing lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.846s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:44:39 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:44:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:44:39 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Creating image(s)
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "/opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "/opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG nova.policy [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0be8e872f1de4248a557155ff1c4f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd44d92dded643eb89d955dbf6b4d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-c552507c-c19c-4aa5-acfa-c920d6df06c1 req-7a0a905f-e23d-4e69-ae82-ffee67a53c25 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-unplugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c552507c-c19c-4aa5-acfa-c920d6df06c1 req-7a0a905f-e23d-4e69-ae82-ffee67a53c25 service nova] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c552507c-c19c-4aa5-acfa-c920d6df06c1 req-7a0a905f-e23d-4e69-ae82-ffee67a53c25 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c552507c-c19c-4aa5-acfa-c920d6df06c1 req-7a0a905f-e23d-4e69-ae82-ffee67a53c25 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-c552507c-c19c-4aa5-acfa-c920d6df06c1 req-7a0a905f-e23d-4e69-ae82-ffee67a53c25 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] No waiting events found dispatching network-vif-unplugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:39 user nova-compute[72990]: WARNING nova.compute.manager [req-c552507c-c19c-4aa5-acfa-c920d6df06c1 req-7a0a905f-e23d-4e69-ae82-ffee67a53c25 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received unexpected event network-vif-unplugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d for instance with vm_state active and task_state rescuing.
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.225s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.235s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk 1073741824" returned: 0 in 0.061s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Instance destroyed successfully.
Aug 27 03:44:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Attempting a stable device rescue
Aug 27 03:44:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72990) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.275s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Instance directory exists: not creating {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 03:44:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Creating image(s)
Aug 27 03:44:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "/opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "/opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "/opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "46dc696991a31238673202fe5b5eb1eb4312a072" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "46dc696991a31238673202fe5b5eb1eb4312a072" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072.part --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Successfully created port: f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-c2925521-414c-4f37-9903-49f951e053a6 req-24016e2a-1854-434c-b61c-f3e99fefb393 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c2925521-414c-4f37-9903-49f951e053a6 req-24016e2a-1854-434c-b61c-f3e99fefb393 service nova] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c2925521-414c-4f37-9903-49f951e053a6 req-24016e2a-1854-434c-b61c-f3e99fefb393 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c2925521-414c-4f37-9903-49f951e053a6 req-24016e2a-1854-434c-b61c-f3e99fefb393 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-c2925521-414c-4f37-9903-49f951e053a6 req-24016e2a-1854-434c-b61c-f3e99fefb393 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] No waiting events found dispatching network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:41 user nova-compute[72990]: WARNING nova.compute.manager [req-c2925521-414c-4f37-9903-49f951e053a6 req-24016e2a-1854-434c-b61c-f3e99fefb393 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received unexpected event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d for instance with vm_state active and task_state rescuing.
Aug 27 03:44:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json" returned: 0 in 1.521s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Cannot resize image /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Ensure instance console log exists: /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072.part --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:42 user nova-compute[72990]: DEBUG nova.virt.images [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] 84586402-b6cf-4c73-8bf4-11cddc911c43 was qcow2, converting to raw {{(pid=72990) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 03:44:42 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:44:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072.part /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072.converted {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072.part /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072.converted" returned: 0 in 0.382s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072.converted --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072.converted --force-share --output=json" returned: 0 in 0.285s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "46dc696991a31238673202fe5b5eb1eb4312a072" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.255s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "46dc696991a31238673202fe5b5eb1eb4312a072" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "46dc696991a31238673202fe5b5eb1eb4312a072" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072 --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072,backing_fmt=raw /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.rescue {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.network.neutron [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Successfully updated port: f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072,backing_fmt=raw /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.rescue" returned: 0 in 0.057s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "46dc696991a31238673202fe5b5eb1eb4312a072" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lazy-loading 'migration_context' on Instance uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquired lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.network.neutron [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.objects.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Object Instance<7835f781-b543-4370-922b-3d2a76f9821b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Start _get_guest_xml network_info=[{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "vif_mac": "fa:16:3e:1c:62:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '84586402-b6cf-4c73-8bf4-11cddc911c43', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'd3c19581-b09d-4b5d-a744-d85b146a4683', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAaSEuhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '7835f781-b543-4370-922b-3d2a76f9821b', 'attached_at': '', 'detached_at': '', 'volume_id': '0dc5c32f-6b98-4193-800d-09f5c79731ab', 'serial': '0dc5c32f-6b98-4193-800d-09f5c79731ab'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lazy-loading 'resources' on Instance uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-bd697d58-b497-4410-ac42-e36c974065b9 req-85dcaf3c-e26e-4cd5-afb1-04bfe02fd901 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-changed-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-bd697d58-b497-4410-ac42-e36c974065b9 req-85dcaf3c-e26e-4cd5-afb1-04bfe02fd901 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Refreshing instance network info cache due to event network-changed-f875fdb9-c314-4ded-9793-cb49e10bbdd8. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bd697d58-b497-4410-ac42-e36c974065b9 req-85dcaf3c-e26e-4cd5-afb1-04bfe02fd901 service nova] Acquiring lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.objects.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Object Instance<7835f781-b543-4370-922b-3d2a76f9821b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lazy-loading 'numa_topology' on Instance uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.objects.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Object Instance<7835f781-b543-4370-922b-3d2a76f9821b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:44:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:44:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.network.neutron [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.objects.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Object Instance<7835f781-b543-4370-922b-3d2a76f9821b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAaSEuhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:44:43 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:44:43 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:44:43 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd1eb49-462f-4edb-b6c3-f5fad8b2ea61]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KAaSEuhj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 03:44:43 user nova-compute[72990]: node.name = iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab
Aug 27 03:44:43 user nova-compute[72990]: node.tpgt = -1
Aug 27 03:44:43 user nova-compute[72990]: node.startup = automatic
Aug 27 03:44:43 user nova-compute[72990]: node.leading_login = No
Aug 27 03:44:43 user nova-compute[72990]: iface.iscsi_ifacename = default
Aug 27 03:44:43 user nova-compute[72990]: iface.net_ifacename = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.ipaddress = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.prefix_len = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.hwaddress = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.transport_name = tcp
Aug 27 03:44:43 user nova-compute[72990]: iface.initiatorname = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.state = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.vlan_id = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.vlan_priority = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.vlan_state = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.iface_num = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.mtu = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.port = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.bootproto = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.subnet_mask = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.gateway = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.dhcp_alt_client_id = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.dhcp_dns = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.dhcp_learn_iqn = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.dhcp_vendor_id_state = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.dhcp_vendor_id = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.dhcp_slp_da = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.fragmentation = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.gratuitous_arp = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.incoming_forwarding = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.tos_state = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.tos = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.ttl = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.delayed_ack = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.tcp_nagle = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.tcp_wsf_state = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.tcp_wsf = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.tcp_timer_scale = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.tcp_timestamp = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.redirect = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.def_task_mgmt_timeout = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.header_digest = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.data_digest = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.immediate_data = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.initial_r2t = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.data_seq_inorder = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.data_pdu_inorder = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.erl = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.max_receive_data_len = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.first_burst_len = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.max_outstanding_r2t = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.max_burst_len = 0
Aug 27 03:44:43 user nova-compute[72990]: iface.chap_auth = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.bidi_chap = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.strict_login_compliance = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.discovery_auth = <empty>
Aug 27 03:44:43 user nova-compute[72990]: iface.discovery_logout = <empty>
Aug 27 03:44:43 user nova-compute[72990]: node.discovery_address = <empty>
Aug 27 03:44:43 user nova-compute[72990]: node.discovery_port = 0
Aug 27 03:44:43 user nova-compute[72990]: node.discovery_type = static
Aug 27 03:44:43 user nova-compute[72990]: node.session.initial_cmdsn = 0
Aug 27 03:44:43 user nova-compute[72990]: node.session.initial_login_retry_max = 8
Aug 27 03:44:43 user nova-compute[72990]: node.session.xmit_thread_priority = -20
Aug 27 03:44:43 user nova-compute[72990]: node.session.cmds_max = 128
Aug 27 03:44:43 user nova-compute[72990]: node.session.queue_depth = 32
Aug 27 03:44:43 user nova-compute[72990]: node.session.nr_sessions = 1
Aug 27 03:44:43 user nova-compute[72990]: node.session.auth.authmethod = CHAP
Aug 27 03:44:43 user nova-compute[72990]: node.session.auth.username = KAaSEuhj
Aug 27 03:44:43 user nova-compute[72990]: node.session.auth.password = ***
Aug 27 03:44:43 user nova-compute[72990]: node.session.auth.username_in = <empty>
Aug 27 03:44:43 user nova-compute[72990]: node.session.auth.password_in = <empty>
Aug 27 03:44:43 user nova-compute[72990]: node.session.auth.chap_algs = MD5
Aug 27 03:44:43 user nova-compute[72990]: node.session.timeo.replacement_timeout = 120
Aug 27 03:44:43 user nova-compute[72990]: node.session.err_timeo.abort_timeout = 15
Aug 27 03:44:43 user nova-compute[72990]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 03:44:43 user nova-compute[72990]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 03:44:43 user nova-compute[72990]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 03:44:43 user nova-compute[72990]: node.session.iscsi.FastAbort = Yes
Aug 27 03:44:43 user nova-compute[72990]: node.session.iscsi.InitialR2T = No
Aug 27 03:44:43 user nova-compute[72990]: node.session.iscsi.ImmediateData = Yes
Aug 27 03:44:43 user nova-compute[72990]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 03:44:43 user nova-compute[72990]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 03:44:43 user nova-compute[72990]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 03:44:43 user nova-compute[72990]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 03:44:43 user nova-compute[72990]: node.session.iscsi.MaxConnections = 1
Aug 27 03:44:43 user nova-compute[72990]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 03:44:43 user nova-compute[72990]: node.session.iscsi.ERL = 0
Aug 27 03:44:43 user nova-compute[72990]: node.session.scan = manual
Aug 27 03:44:43 user nova-compute[72990]: node.session.reopen_max = 0
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].address = 172.16.0.220
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].port = 3260
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].startup = manual
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].tcp.window_size = 524288
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].tcp.type_of_service = 0
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].timeo.logout_timeout = 15
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].timeo.login_timeout = 15
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].timeo.auth_timeout = 45
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].iscsi.DataDigest = None
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].iscsi.IFMarker = No
Aug 27 03:44:43 user nova-compute[72990]: node.conn[0].iscsi.OFMarker = No
Aug 27 03:44:43 user nova-compute[72990]: # END RECORD
Aug 27 03:44:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e44d80-4725-4402-8d9a-f2ca0f77b675]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[73924e03-438c-4f91-84c6-2f16685c55f3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KAaSEuhj {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KAaSEuhj" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0508f3-3adf-4808-9431-be9aa558fa3d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KAaSEuhj'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8c5556-13f3-43c0-94c7-eaacc8006d25]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bc22fa-0703-4abc-b135-8eb960a0ec64]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:44:43 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:44:43 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:44:43 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:44:43 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:44:43 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:44:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:44:43 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:44:43 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:44:43 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:44:43 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:44:43 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:44:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.167s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] HCTL ('38', '0', '0', 0) found on session 13 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ab4ecc-7d67-42d0-a687-83f832f8958a]: (4, ('0 0 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Searching for a device in session 13 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAaSEuhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '26161373538653931', 'path': '/dev/sdg'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161373538653931', 'path': '/dev/sdg'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.network.neutron [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updating instance_info_cache with network_info: [{"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Releasing lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Instance network_info: |[{"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1426790154',display_name='tempest-ServerStableDeviceRescueTest-server-1426790154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1426790154',id=4,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuie8I1zmPTJR4MWFJd4uL9H7Y7zaw0i0/HxDbhxujiX8dZTY7PejDyY5i59a4QWzNZOOaKk6B+aPRfLvRmlc5NyO+hiXVGcLw0acVKee1aqH5Y4VgHEQo51OQ+4w65xg==',key_name='tempest-keypair-1407954263',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:40:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37efbadb079847d6852574734e40de9a',ramdisk_id='',reservation_id='r-q7dxzftt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-181138782',owner_user_name='tempest-ServerStableDeviceRescueTest-181138782-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:42:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5856ab8a362e440abcb62fdbc61f495b',uuid=7835f781-b543-4370-922b-3d2a76f9821b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "vif_mac": "fa:16:3e:1c:62:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Converting VIF {"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "vif_mac": "fa:16:3e:1c:62:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:62:6e,bridge_name='br-int',has_traffic_filtering=True,id=eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d,network=Network(58588dcd-f0f9-4efd-91b7-a15aeec22905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb08b4e3-74') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lazy-loading 'pci_devices' on Instance uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bd697d58-b497-4410-ac42-e36c974065b9 req-85dcaf3c-e26e-4cd5-afb1-04bfe02fd901 service nova] Acquired lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.network.neutron [req-bd697d58-b497-4410-ac42-e36c974065b9 req-85dcaf3c-e26e-4cd5-afb1-04bfe02fd901 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Refreshing network info cache for port f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Start _get_guest_xml network_info=[{"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.objects.base [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Object Instance<7835f781-b543-4370-922b-3d2a76f9821b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:44:43 user nova-compute[72990]:   <uuid>7835f781-b543-4370-922b-3d2a76f9821b</uuid>
Aug 27 03:44:43 user nova-compute[72990]:   <name>instance-00000004</name>
Aug 27 03:44:43 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:44:43 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:44:43 user nova-compute[72990]:   <metadata>
Aug 27 03:44:43 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:44:43 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:44:43 user nova-compute[72990]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1426790154</nova:name>
Aug 27 03:44:43 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:44:43</nova:creationTime>
Aug 27 03:44:43 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:44:43 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:44:43 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:44:43 user nova-compute[72990]:       <nova:owner>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:user uuid="5856ab8a362e440abcb62fdbc61f495b">tempest-ServerStableDeviceRescueTest-181138782-project-member</nova:user>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:project uuid="37efbadb079847d6852574734e40de9a">tempest-ServerStableDeviceRescueTest-181138782</nova:project>
Aug 27 03:44:43 user nova-compute[72990]:       </nova:owner>
Aug 27 03:44:43 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:44:43 user nova-compute[72990]:       <nova:ports>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:port uuid="eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d">
Aug 27 03:44:43 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 03:44:43 user nova-compute[72990]:         </nova:port>
Aug 27 03:44:43 user nova-compute[72990]:       </nova:ports>
Aug 27 03:44:43 user nova-compute[72990]:     </nova:instance>
Aug 27 03:44:43 user nova-compute[72990]:   </metadata>
Aug 27 03:44:43 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:44:43 user nova-compute[72990]:     <system>
Aug 27 03:44:43 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:44:43 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:44:43 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:44:43 user nova-compute[72990]:       <entry name="serial">7835f781-b543-4370-922b-3d2a76f9821b</entry>
Aug 27 03:44:43 user nova-compute[72990]:       <entry name="uuid">7835f781-b543-4370-922b-3d2a76f9821b</entry>
Aug 27 03:44:43 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:44:43 user nova-compute[72990]:     </system>
Aug 27 03:44:43 user nova-compute[72990]:   </sysinfo>
Aug 27 03:44:43 user nova-compute[72990]:   <os>
Aug 27 03:44:43 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:44:43 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:44:43 user nova-compute[72990]:   </os>
Aug 27 03:44:43 user nova-compute[72990]:   <features>
Aug 27 03:44:43 user nova-compute[72990]:     <acpi/>
Aug 27 03:44:43 user nova-compute[72990]:     <apic/>
Aug 27 03:44:43 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:44:43 user nova-compute[72990]:   </features>
Aug 27 03:44:43 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:44:43 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:44:43 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:44:43 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:44:43 user nova-compute[72990]:   </clock>
Aug 27 03:44:43 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:44:43 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:44:43 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:44:43 user nova-compute[72990]:   </cpu>
Aug 27 03:44:43 user nova-compute[72990]:   <devices>
Aug 27 03:44:43 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:44:43 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:44:43 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk"/>
Aug 27 03:44:43 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:44:43 user nova-compute[72990]:     </disk>
Aug 27 03:44:43 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:44:43 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:44:43 user nova-compute[72990]:       <source dev="/dev/sdg"/>
Aug 27 03:44:43 user nova-compute[72990]:       <target dev="vdb" bus="virtio"/>
Aug 27 03:44:43 user nova-compute[72990]:       <serial>0dc5c32f-6b98-4193-800d-09f5c79731ab</serial>
Aug 27 03:44:43 user nova-compute[72990]:     </disk>
Aug 27 03:44:43 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:44:43 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:44:43 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.rescue"/>
Aug 27 03:44:43 user nova-compute[72990]:       <target dev="vdc" bus="virtio"/>
Aug 27 03:44:43 user nova-compute[72990]:       <boot order="1"/>
Aug 27 03:44:43 user nova-compute[72990]:     </disk>
Aug 27 03:44:43 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:44:43 user nova-compute[72990]:       <mac address="fa:16:3e:1c:62:6e"/>
Aug 27 03:44:43 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:44:43 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:44:43 user nova-compute[72990]:       <target dev="tapeb08b4e3-74"/>
Aug 27 03:44:43 user nova-compute[72990]:     </interface>
Aug 27 03:44:43 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:44:43 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/console.log" append="off"/>
Aug 27 03:44:43 user nova-compute[72990]:     </serial>
Aug 27 03:44:43 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:44:43 user nova-compute[72990]:     <video>
Aug 27 03:44:43 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:44:43 user nova-compute[72990]:     </video>
Aug 27 03:44:43 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:44:43 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:44:43 user nova-compute[72990]:     </rng>
Aug 27 03:44:43 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:44:43 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:44:43 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:44:43 user nova-compute[72990]:     </memballoon>
Aug 27 03:44:43 user nova-compute[72990]:   </devices>
Aug 27 03:44:43 user nova-compute[72990]: </domain>
Aug 27 03:44:43 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:44:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:44:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:44:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-540718096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-540718096',id=16,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT6IrDqHUyj+WWqRbXtufrlRqRkgo3D56ibga6nfxeKOdSyMT8pY8NCJaScOf+GpkgEwVia9hfEYPOo+O3C0AiPNser5LSpeMDp9MmOv0BFJxJBFs/HXMLQxNaegz6f0w==',key_name='tempest-keypair-1260377371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd44d92dded643eb89d955dbf6b4d1e3',ramdisk_id='',reservation_id='r-s07xb5he',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2085503517',owner_user_name='tempest-AttachVolumeShelveTestJSON-2085503517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:44:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be8e872f1de4248a557155ff1c4f5ec',uuid=1e81de88-259e-4124-8e2c-cafd310a9b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converting VIF {"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.objects.instance [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:43 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Instance destroyed successfully.
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:44:43 user nova-compute[72990]:   <uuid>1e81de88-259e-4124-8e2c-cafd310a9b42</uuid>
Aug 27 03:44:43 user nova-compute[72990]:   <name>instance-00000010</name>
Aug 27 03:44:43 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:44:43 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:44:43 user nova-compute[72990]:   <metadata>
Aug 27 03:44:43 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:44:43 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:44:43 user nova-compute[72990]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-540718096</nova:name>
Aug 27 03:44:43 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:44:43</nova:creationTime>
Aug 27 03:44:43 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:44:43 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:44:43 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:44:43 user nova-compute[72990]:       <nova:owner>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:user uuid="0be8e872f1de4248a557155ff1c4f5ec">tempest-AttachVolumeShelveTestJSON-2085503517-project-member</nova:user>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:project uuid="bd44d92dded643eb89d955dbf6b4d1e3">tempest-AttachVolumeShelveTestJSON-2085503517</nova:project>
Aug 27 03:44:43 user nova-compute[72990]:       </nova:owner>
Aug 27 03:44:43 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:44:43 user nova-compute[72990]:       <nova:ports>
Aug 27 03:44:43 user nova-compute[72990]:         <nova:port uuid="f875fdb9-c314-4ded-9793-cb49e10bbdd8">
Aug 27 03:44:43 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 03:44:43 user nova-compute[72990]:         </nova:port>
Aug 27 03:44:43 user nova-compute[72990]:       </nova:ports>
Aug 27 03:44:43 user nova-compute[72990]:     </nova:instance>
Aug 27 03:44:43 user nova-compute[72990]:   </metadata>
Aug 27 03:44:43 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:44:43 user nova-compute[72990]:     <system>
Aug 27 03:44:43 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:44:43 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:44:43 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:44:43 user nova-compute[72990]:       <entry name="serial">1e81de88-259e-4124-8e2c-cafd310a9b42</entry>
Aug 27 03:44:43 user nova-compute[72990]:       <entry name="uuid">1e81de88-259e-4124-8e2c-cafd310a9b42</entry>
Aug 27 03:44:43 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:44:43 user nova-compute[72990]:     </system>
Aug 27 03:44:43 user nova-compute[72990]:   </sysinfo>
Aug 27 03:44:43 user nova-compute[72990]:   <os>
Aug 27 03:44:43 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:44:43 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:44:43 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:44:43 user nova-compute[72990]:   </os>
Aug 27 03:44:43 user nova-compute[72990]:   <features>
Aug 27 03:44:43 user nova-compute[72990]:     <acpi/>
Aug 27 03:44:43 user nova-compute[72990]:     <apic/>
Aug 27 03:44:43 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:44:43 user nova-compute[72990]:   </features>
Aug 27 03:44:43 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:44:43 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:44:43 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:44:43 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:44:43 user nova-compute[72990]:   </clock>
Aug 27 03:44:43 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:44:43 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:44:43 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:44:43 user nova-compute[72990]:   </cpu>
Aug 27 03:44:43 user nova-compute[72990]:   <devices>
Aug 27 03:44:43 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:44:43 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:44:43 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk"/>
Aug 27 03:44:43 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:44:43 user nova-compute[72990]:     </disk>
Aug 27 03:44:43 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:44:43 user nova-compute[72990]:       <mac address="fa:16:3e:e1:25:a5"/>
Aug 27 03:44:43 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:44:43 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:44:43 user nova-compute[72990]:       <target dev="tapf875fdb9-c3"/>
Aug 27 03:44:43 user nova-compute[72990]:     </interface>
Aug 27 03:44:43 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:44:43 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/console.log" append="off"/>
Aug 27 03:44:43 user nova-compute[72990]:     </serial>
Aug 27 03:44:43 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:44:43 user nova-compute[72990]:     <video>
Aug 27 03:44:43 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:44:43 user nova-compute[72990]:     </video>
Aug 27 03:44:43 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:44:43 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:44:43 user nova-compute[72990]:     </rng>
Aug 27 03:44:43 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:44:43 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:44:43 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:44:43 user nova-compute[72990]:     </memballoon>
Aug 27 03:44:43 user nova-compute[72990]:   </devices>
Aug 27 03:44:43 user nova-compute[72990]: </domain>
Aug 27 03:44:43 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:44:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-540718096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-540718096',id=16,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT6IrDqHUyj+WWqRbXtufrlRqRkgo3D56ibga6nfxeKOdSyMT8pY8NCJaScOf+GpkgEwVia9hfEYPOo+O3C0AiPNser5LSpeMDp9MmOv0BFJxJBFs/HXMLQxNaegz6f0w==',key_name='tempest-keypair-1260377371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd44d92dded643eb89d955dbf6b4d1e3',ramdisk_id='',reservation_id='r-s07xb5he',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2085503517',owner_user_name='tempest-AttachVolumeShelveTestJSON-2085503517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:44:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be8e872f1de4248a557155ff1c4f5ec',uuid=1e81de88-259e-4124-8e2c-cafd310a9b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converting VIF {"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG os_vif [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf875fdb9-c3, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf875fdb9-c3, col_values=(('external_ids', {'iface-id': 'f875fdb9-c314-4ded-9793-cb49e10bbdd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:25:a5', 'vm-uuid': '1e81de88-259e-4124-8e2c-cafd310a9b42'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:43 user nova-compute[72990]: INFO os_vif [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3')
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] No VIF found with MAC fa:16:3e:1c:62:6e, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:44:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] No VIF found with MAC fa:16:3e:e1:25:a5, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:44:44 user nova-compute[72990]: DEBUG nova.network.neutron [req-bd697d58-b497-4410-ac42-e36c974065b9 req-85dcaf3c-e26e-4cd5-afb1-04bfe02fd901 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updated VIF entry in instance network info cache for port f875fdb9-c314-4ded-9793-cb49e10bbdd8. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:44:44 user nova-compute[72990]: DEBUG nova.network.neutron [req-bd697d58-b497-4410-ac42-e36c974065b9 req-85dcaf3c-e26e-4cd5-afb1-04bfe02fd901 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updating instance_info_cache with network_info: [{"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bd697d58-b497-4410-ac42-e36c974065b9 req-85dcaf3c-e26e-4cd5-afb1-04bfe02fd901 service nova] Releasing lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-bf93aca1-56c2-4e6e-afa6-d67267fe3010 req-c7d362bb-0092-4061-a8a8-1641750c16ee service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-changed-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-bf93aca1-56c2-4e6e-afa6-d67267fe3010 req-c7d362bb-0092-4061-a8a8-1641750c16ee service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Refreshing instance network info cache due to event network-changed-9baf50ad-1b30-457c-a390-d815d4da3ac8. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bf93aca1-56c2-4e6e-afa6-d67267fe3010 req-c7d362bb-0092-4061-a8a8-1641750c16ee service nova] Acquiring lock "refresh_cache-e4842b80-80e8-4df9-a4bb-30529de4a013" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bf93aca1-56c2-4e6e-afa6-d67267fe3010 req-c7d362bb-0092-4061-a8a8-1641750c16ee service nova] Acquired lock "refresh_cache-e4842b80-80e8-4df9-a4bb-30529de4a013" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-bf93aca1-56c2-4e6e-afa6-d67267fe3010 req-c7d362bb-0092-4061-a8a8-1641750c16ee service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Refreshing network info cache for port 9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "e4842b80-80e8-4df9-a4bb-30529de4a013" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:45 user nova-compute[72990]: INFO nova.compute.manager [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Terminating instance
Aug 27 03:44:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-bf93aca1-56c2-4e6e-afa6-d67267fe3010 req-c7d362bb-0092-4061-a8a8-1641750c16ee service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Updated VIF entry in instance network info cache for port 9baf50ad-1b30-457c-a390-d815d4da3ac8. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-bf93aca1-56c2-4e6e-afa6-d67267fe3010 req-c7d362bb-0092-4061-a8a8-1641750c16ee service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Updating instance_info_cache with network_info: [{"id": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "address": "fa:16:3e:3f:15:71", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baf50ad-1b", "ovs_interfaceid": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bf93aca1-56c2-4e6e-afa6-d67267fe3010 req-c7d362bb-0092-4061-a8a8-1641750c16ee service nova] Releasing lock "refresh_cache-e4842b80-80e8-4df9-a4bb-30529de4a013" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-9117d9d2-0d1e-48e2-8dfd-0901fbb83ea0 req-a85c690a-921b-42e0-8972-f7e196f37a39 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-vif-unplugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9117d9d2-0d1e-48e2-8dfd-0901fbb83ea0 req-a85c690a-921b-42e0-8972-f7e196f37a39 service nova] Acquiring lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9117d9d2-0d1e-48e2-8dfd-0901fbb83ea0 req-a85c690a-921b-42e0-8972-f7e196f37a39 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9117d9d2-0d1e-48e2-8dfd-0901fbb83ea0 req-a85c690a-921b-42e0-8972-f7e196f37a39 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-9117d9d2-0d1e-48e2-8dfd-0901fbb83ea0 req-a85c690a-921b-42e0-8972-f7e196f37a39 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] No waiting events found dispatching network-vif-unplugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-9117d9d2-0d1e-48e2-8dfd-0901fbb83ea0 req-a85c690a-921b-42e0-8972-f7e196f37a39 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-vif-unplugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693107871.52215, a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:44:46 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] VM Stopped (Lifecycle Event)
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d75a507b-a062-4fa4-ab88-64fbb380d20c None None] [instance: a5a89ba6-d8c3-4eed-8a6b-604d04b3fd63] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Instance destroyed successfully.
Aug 27 03:44:46 user nova-compute[72990]: DEBUG nova.objects.instance [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'resources' on Instance uuid e4842b80-80e8-4df9-a4bb-30529de4a013 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1289814881',display_name='tempest-AttachVolumeNegativeTest-server-1289814881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1289814881',id=12,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGwPZxxgZ6U5gizU4XbGVi3XvdYVGwnZSHH1e8wPFzu10+6hYJKlyI5B2w+4xeV9SkHAoKXeYHWql29ZjPQqzJjy1I49JygP+c4PdcW7eolOq9gmsh7O7ZioydX5l1dNA==',key_name='tempest-keypair-778008372',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:43:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d007a65dbbce40729d2d7a25561a4f91',ramdisk_id='',reservation_id='r-la4ew2ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-945598863',owner_user_name='tempest-AttachVolumeNegativeTest-945598863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7d2fc4d4204ad38d0d11376de45bd6',uuid=e4842b80-80e8-4df9-a4bb-30529de4a013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "address": "fa:16:3e:3f:15:71", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baf50ad-1b", "ovs_interfaceid": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converting VIF {"id": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "address": "fa:16:3e:3f:15:71", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baf50ad-1b", "ovs_interfaceid": "9baf50ad-1b30-457c-a390-d815d4da3ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:15:71,bridge_name='br-int',has_traffic_filtering=True,id=9baf50ad-1b30-457c-a390-d815d4da3ac8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baf50ad-1b') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG os_vif [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:15:71,bridge_name='br-int',has_traffic_filtering=True,id=9baf50ad-1b30-457c-a390-d815d4da3ac8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baf50ad-1b') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9baf50ad-1b, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: INFO os_vif [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:15:71,bridge_name='br-int',has_traffic_filtering=True,id=9baf50ad-1b30-457c-a390-d815d4da3ac8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baf50ad-1b')
Aug 27 03:44:47 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Deleting instance files /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013_del
Aug 27 03:44:47 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Deletion of /opt/stack/data/nova/instances/e4842b80-80e8-4df9-a4bb-30529de4a013_del complete
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: INFO nova.compute.manager [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 27 03:44:47 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-21ad945e-1afb-4f1c-a550-e4d4c43f583e req-31240efc-f6ee-47f9-a383-42201a44752d service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-21ad945e-1afb-4f1c-a550-e4d4c43f583e req-31240efc-f6ee-47f9-a383-42201a44752d service nova] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-21ad945e-1afb-4f1c-a550-e4d4c43f583e req-31240efc-f6ee-47f9-a383-42201a44752d service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-21ad945e-1afb-4f1c-a550-e4d4c43f583e req-31240efc-f6ee-47f9-a383-42201a44752d service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-21ad945e-1afb-4f1c-a550-e4d4c43f583e req-31240efc-f6ee-47f9-a383-42201a44752d service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] No waiting events found dispatching network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:47 user nova-compute[72990]: WARNING nova.compute.manager [req-21ad945e-1afb-4f1c-a550-e4d4c43f583e req-31240efc-f6ee-47f9-a383-42201a44752d service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received unexpected event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d for instance with vm_state active and task_state rescuing.
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Acquiring lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] No waiting events found dispatching network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:48 user nova-compute[72990]: WARNING nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received unexpected event network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 for instance with vm_state active and task_state deleting.
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Acquiring lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] No waiting events found dispatching network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:48 user nova-compute[72990]: WARNING nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received unexpected event network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 for instance with vm_state active and task_state deleting.
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Acquiring lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] No waiting events found dispatching network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:48 user nova-compute[72990]: WARNING nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received unexpected event network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 for instance with vm_state active and task_state deleting.
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-vif-unplugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Acquiring lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] No waiting events found dispatching network-vif-unplugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-vif-unplugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Acquiring lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] No waiting events found dispatching network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:48 user nova-compute[72990]: WARNING nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received unexpected event network-vif-plugged-9baf50ad-1b30-457c-a390-d815d4da3ac8 for instance with vm_state active and task_state deleting.
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] No waiting events found dispatching network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:48 user nova-compute[72990]: WARNING nova.compute.manager [req-2a99b487-27f9-4c93-b412-9a6c832942e7 req-ed28b557-0c18-4ab8-ba34-bf7017b85bb5 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received unexpected event network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 for instance with vm_state building and task_state spawning.
Aug 27 03:44:48 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:48 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Took 1.56 seconds to deallocate network for instance.
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:49 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:44:49 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:44:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:49 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Deleted allocations for instance e4842b80-80e8-4df9-a4bb-30529de4a013
Aug 27 03:44:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-51cc8ac6-e14b-4f6a-ac1d-00c3ae461e35 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "e4842b80-80e8-4df9-a4bb-30529de4a013" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.498s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-f738017c-987e-4326-9775-a5155086f907 req-40750295-787f-411b-abf3-b561d0e398a3 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f738017c-987e-4326-9775-a5155086f907 req-40750295-787f-411b-abf3-b561d0e398a3 service nova] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f738017c-987e-4326-9775-a5155086f907 req-40750295-787f-411b-abf3-b561d0e398a3 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f738017c-987e-4326-9775-a5155086f907 req-40750295-787f-411b-abf3-b561d0e398a3 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-f738017c-987e-4326-9775-a5155086f907 req-40750295-787f-411b-abf3-b561d0e398a3 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] No waiting events found dispatching network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:49 user nova-compute[72990]: WARNING nova.compute.manager [req-f738017c-987e-4326-9775-a5155086f907 req-40750295-787f-411b-abf3-b561d0e398a3 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received unexpected event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d for instance with vm_state active and task_state rescuing.
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107890.0169463, 1e81de88-259e-4124-8e2c-cafd310a9b42 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:44:50 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] VM Resumed (Lifecycle Event)
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:44:50 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Instance spawned successfully.
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c5a5843d-d3de-4907-8b1b-bc67fa487af2 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:44:50 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107890.0181584, 1e81de88-259e-4124-8e2c-cafd310a9b42 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:44:50 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] VM Started (Lifecycle Event)
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:44:50 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Removed pending event for 7835f781-b543-4370-922b-3d2a76f9821b due to event {{(pid=72990) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107890.041538, 7835f781-b543-4370-922b-3d2a76f9821b => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:44:50 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] VM Resumed (Lifecycle Event)
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:50 user nova-compute[72990]: INFO nova.compute.manager [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Took 10.52 seconds to spawn the instance on the hypervisor.
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107890.042746, 7835f781-b543-4370-922b-3d2a76f9821b => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:44:50 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] VM Started (Lifecycle Event)
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:44:50 user nova-compute[72990]: INFO nova.compute.manager [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Took 11.79 seconds to build instance.
Aug 27 03:44:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-86e4606a-fbe0-4ee3-bcc4-76b6b368e40c tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.911s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a90530a-aa0a-4ef8-9014-e4e9fb6b1128 req-4c1832f9-0cec-4050-9639-dbed8c9f46c8 service nova] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Received event network-vif-deleted-9baf50ad-1b30-457c-a390-d815d4da3ac8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a90530a-aa0a-4ef8-9014-e4e9fb6b1128 req-4c1832f9-0cec-4050-9639-dbed8c9f46c8 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a90530a-aa0a-4ef8-9014-e4e9fb6b1128 req-4c1832f9-0cec-4050-9639-dbed8c9f46c8 service nova] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a90530a-aa0a-4ef8-9014-e4e9fb6b1128 req-4c1832f9-0cec-4050-9639-dbed8c9f46c8 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a90530a-aa0a-4ef8-9014-e4e9fb6b1128 req-4c1832f9-0cec-4050-9639-dbed8c9f46c8 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a90530a-aa0a-4ef8-9014-e4e9fb6b1128 req-4c1832f9-0cec-4050-9639-dbed8c9f46c8 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] No waiting events found dispatching network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:50 user nova-compute[72990]: WARNING nova.compute.manager [req-0a90530a-aa0a-4ef8-9014-e4e9fb6b1128 req-4c1832f9-0cec-4050-9639-dbed8c9f46c8 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received unexpected event network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 for instance with vm_state active and task_state None.
Aug 27 03:44:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:52 user nova-compute[72990]: INFO nova.compute.manager [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Terminating instance
Aug 27 03:44:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-687b350b-9e5f-4c82-95d7-65ace41f6d19 req-d4290857-ff5a-43e0-b723-fbbd482a8e2b service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Received event network-vif-unplugged-201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-687b350b-9e5f-4c82-95d7-65ace41f6d19 req-d4290857-ff5a-43e0-b723-fbbd482a8e2b service nova] Acquiring lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-687b350b-9e5f-4c82-95d7-65ace41f6d19 req-d4290857-ff5a-43e0-b723-fbbd482a8e2b service nova] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-687b350b-9e5f-4c82-95d7-65ace41f6d19 req-d4290857-ff5a-43e0-b723-fbbd482a8e2b service nova] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-687b350b-9e5f-4c82-95d7-65ace41f6d19 req-d4290857-ff5a-43e0-b723-fbbd482a8e2b service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] No waiting events found dispatching network-vif-unplugged-201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-687b350b-9e5f-4c82-95d7-65ace41f6d19 req-d4290857-ff5a-43e0-b723-fbbd482a8e2b service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Received event network-vif-unplugged-201b57cf-6d21-45f8-8b60-0aa05a6c24af for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:44:53 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Instance destroyed successfully.
Aug 27 03:44:53 user nova-compute[72990]: DEBUG nova.objects.instance [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lazy-loading 'resources' on Instance uuid a388d657-a11d-4a63-b7fc-2df799ca72d0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-757872244',display_name='tempest-TestVolumeSwap-server-757872244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-757872244',id=9,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBB79Li5dPDaozy0ishpPAv31zHsGnQ/xaGTVBbCiswsunHMgfLPOI0me+oWPuowtzMXXlnKhgx1ABiFg+220LtfvqDT0DIdUv+2c78rXcss+nqggSTqSkGq6swjj99H7Q==',key_name='tempest-keypair-514096999',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef7bf02a47b04791acfb0c2ef68f8a09',ramdisk_id='',reservation_id='r-37om2svg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1681906464',owner_user_name='tempest-TestVolumeSwap-1681906464-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7d9a50df59847eb9951ead87499ffb0',uuid=a388d657-a11d-4a63-b7fc-2df799ca72d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "address": "fa:16:3e:1d:b5:ae", "network": {"id": "7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-491390485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef7bf02a47b04791acfb0c2ef68f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201b57cf-6d", "ovs_interfaceid": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Converting VIF {"id": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "address": "fa:16:3e:1d:b5:ae", "network": {"id": "7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-491390485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef7bf02a47b04791acfb0c2ef68f8a09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201b57cf-6d", "ovs_interfaceid": "201b57cf-6d21-45f8-8b60-0aa05a6c24af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b5:ae,bridge_name='br-int',has_traffic_filtering=True,id=201b57cf-6d21-45f8-8b60-0aa05a6c24af,network=Network(7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201b57cf-6d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG os_vif [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b5:ae,bridge_name='br-int',has_traffic_filtering=True,id=201b57cf-6d21-45f8-8b60-0aa05a6c24af,network=Network(7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201b57cf-6d') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap201b57cf-6d, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:53 user nova-compute[72990]: INFO os_vif [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:b5:ae,bridge_name='br-int',has_traffic_filtering=True,id=201b57cf-6d21-45f8-8b60-0aa05a6c24af,network=Network(7f0cf5d3-b7e1-493e-84f9-f4ae86e3ecd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201b57cf-6d')
Aug 27 03:44:53 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Deleting instance files /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0_del
Aug 27 03:44:53 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Deletion of /opt/stack/data/nova/instances/a388d657-a11d-4a63-b7fc-2df799ca72d0_del complete
Aug 27 03:44:53 user nova-compute[72990]: INFO nova.compute.manager [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 27 03:44:53 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:44:53 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:44:54 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:44:54 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Took 0.97 seconds to deallocate network for instance.
Aug 27 03:44:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-5d3d0360-fba5-447f-82b6-5c433e4f75d0 req-a811e549-e8e4-4a4c-9b5d-836e2551f5f2 service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Received event network-vif-deleted-201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:55 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:44:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-08065c94-1cd8-4a3b-b730-8cba99838e70 req-9bafe8e1-2be2-434c-a14e-55ee0b078681 service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Received event network-vif-plugged-201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:44:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-08065c94-1cd8-4a3b-b730-8cba99838e70 req-9bafe8e1-2be2-434c-a14e-55ee0b078681 service nova] Acquiring lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:44:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-08065c94-1cd8-4a3b-b730-8cba99838e70 req-9bafe8e1-2be2-434c-a14e-55ee0b078681 service nova] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:44:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-08065c94-1cd8-4a3b-b730-8cba99838e70 req-9bafe8e1-2be2-434c-a14e-55ee0b078681 service nova] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-08065c94-1cd8-4a3b-b730-8cba99838e70 req-9bafe8e1-2be2-434c-a14e-55ee0b078681 service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] No waiting events found dispatching network-vif-plugged-201b57cf-6d21-45f8-8b60-0aa05a6c24af {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:44:55 user nova-compute[72990]: WARNING nova.compute.manager [req-08065c94-1cd8-4a3b-b730-8cba99838e70 req-9bafe8e1-2be2-434c-a14e-55ee0b078681 service nova] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Received unexpected event network-vif-plugged-201b57cf-6d21-45f8-8b60-0aa05a6c24af for instance with vm_state deleted and task_state None.
Aug 27 03:44:55 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:44:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:55 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Deleted allocations for instance a388d657-a11d-4a63-b7fc-2df799ca72d0
Aug 27 03:44:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4f24441e-1226-472e-bc05-f2b644802e9d tempest-TestVolumeSwap-1681906464 tempest-TestVolumeSwap-1681906464-project-member] Lock "a388d657-a11d-4a63-b7fc-2df799ca72d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.802s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:44:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:44:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:01 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693107886.8719094, e4842b80-80e8-4df9-a4bb-30529de4a013 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:45:01 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] VM Stopped (Lifecycle Event)
Aug 27 03:45:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-31ab8ab8-4d5d-4520-8e58-a4744cb4398c None None] [instance: e4842b80-80e8-4df9-a4bb-30529de4a013] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:45:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-93b261f0-2bb3-4dc0-82f8-77d33c3ae8dc req-83f50c0c-eec9-453f-bda0-d70545df8bd0 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-changed-37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-93b261f0-2bb3-4dc0-82f8-77d33c3ae8dc req-83f50c0c-eec9-453f-bda0-d70545df8bd0 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing instance network info cache due to event network-changed-37ba863e-2224-43c9-8b0e-76d42e1ec9ac. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:45:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-93b261f0-2bb3-4dc0-82f8-77d33c3ae8dc req-83f50c0c-eec9-453f-bda0-d70545df8bd0 service nova] Acquiring lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:45:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-93b261f0-2bb3-4dc0-82f8-77d33c3ae8dc req-83f50c0c-eec9-453f-bda0-d70545df8bd0 service nova] Acquired lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:45:02 user nova-compute[72990]: DEBUG nova.network.neutron [req-93b261f0-2bb3-4dc0-82f8-77d33c3ae8dc req-83f50c0c-eec9-453f-bda0-d70545df8bd0 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Refreshing network info cache for port 37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:45:03 user nova-compute[72990]: DEBUG nova.network.neutron [req-93b261f0-2bb3-4dc0-82f8-77d33c3ae8dc req-83f50c0c-eec9-453f-bda0-d70545df8bd0 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updated VIF entry in instance network info cache for port 37ba863e-2224-43c9-8b0e-76d42e1ec9ac. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:45:03 user nova-compute[72990]: DEBUG nova.network.neutron [req-93b261f0-2bb3-4dc0-82f8-77d33c3ae8dc req-83f50c0c-eec9-453f-bda0-d70545df8bd0 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating instance_info_cache with network_info: [{"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "address": "fa:16:3e:3b:1b:87", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd9f8-3d", "ovs_interfaceid": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:45:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-93b261f0-2bb3-4dc0-82f8-77d33c3ae8dc req-83f50c0c-eec9-453f-bda0-d70545df8bd0 service nova] Releasing lock "refresh_cache-bbab26b4-9515-4427-a01c-04f4a85b1fa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:45:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:06 user nova-compute[72990]: INFO nova.compute.manager [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Terminating instance
Aug 27 03:45:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:45:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-5e035fec-5dd8-459a-bc81-dc5e2a027415 req-879742fc-1d29-4f87-8d9b-b382c0ab447e service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5e035fec-5dd8-459a-bc81-dc5e2a027415 req-879742fc-1d29-4f87-8d9b-b382c0ab447e service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5e035fec-5dd8-459a-bc81-dc5e2a027415 req-879742fc-1d29-4f87-8d9b-b382c0ab447e service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5e035fec-5dd8-459a-bc81-dc5e2a027415 req-879742fc-1d29-4f87-8d9b-b382c0ab447e service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-5e035fec-5dd8-459a-bc81-dc5e2a027415 req-879742fc-1d29-4f87-8d9b-b382c0ab447e service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-unplugged-37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-5e035fec-5dd8-459a-bc81-dc5e2a027415 req-879742fc-1d29-4f87-8d9b-b382c0ab447e service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-37ba863e-2224-43c9-8b0e-76d42e1ec9ac for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-f503f188-0c92-4cd7-8c84-e19fa5b2574a req-c12efd6d-4142-4e28-925b-8e43a94a8fcd service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-3317df18-83e4-4bba-9edb-ca6db2cc4295 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f503f188-0c92-4cd7-8c84-e19fa5b2574a req-c12efd6d-4142-4e28-925b-8e43a94a8fcd service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f503f188-0c92-4cd7-8c84-e19fa5b2574a req-c12efd6d-4142-4e28-925b-8e43a94a8fcd service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f503f188-0c92-4cd7-8c84-e19fa5b2574a req-c12efd6d-4142-4e28-925b-8e43a94a8fcd service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-f503f188-0c92-4cd7-8c84-e19fa5b2574a req-c12efd6d-4142-4e28-925b-8e43a94a8fcd service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-unplugged-3317df18-83e4-4bba-9edb-ca6db2cc4295 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-f503f188-0c92-4cd7-8c84-e19fa5b2574a req-c12efd6d-4142-4e28-925b-8e43a94a8fcd service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-3317df18-83e4-4bba-9edb-ca6db2cc4295 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-4d32037d-0469-4229-801a-d1700a53168c req-114b095b-405d-4a3e-bb1c-280d2ccf7fc4 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4d32037d-0469-4229-801a-d1700a53168c req-114b095b-405d-4a3e-bb1c-280d2ccf7fc4 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4d32037d-0469-4229-801a-d1700a53168c req-114b095b-405d-4a3e-bb1c-280d2ccf7fc4 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4d32037d-0469-4229-801a-d1700a53168c req-114b095b-405d-4a3e-bb1c-280d2ccf7fc4 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-4d32037d-0469-4229-801a-d1700a53168c req-114b095b-405d-4a3e-bb1c-280d2ccf7fc4 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-unplugged-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-4d32037d-0469-4229-801a-d1700a53168c req-114b095b-405d-4a3e-bb1c-280d2ccf7fc4 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Instance destroyed successfully.
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.objects.instance [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lazy-loading 'resources' on Instance uuid bbab26b4-9515-4427-a01c-04f4a85b1fa8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:d1:99,bridge_name='br-int',has_traffic_filtering=True,id=37ba863e-2224-43c9-8b0e-76d42e1ec9ac,network=Network(313da542-8e92-4faa-92ed-8d52cd21e2f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ba863e-22') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:d1:99,bridge_name='br-int',has_traffic_filtering=True,id=37ba863e-2224-43c9-8b0e-76d42e1ec9ac,network=Network(313da542-8e92-4faa-92ed-8d52cd21e2f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ba863e-22') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37ba863e-22, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: INFO os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:d1:99,bridge_name='br-int',has_traffic_filtering=True,id=37ba863e-2224-43c9-8b0e-76d42e1ec9ac,network=Network(313da542-8e92-4faa-92ed-8d52cd21e2f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ba863e-22')
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=3317df18-83e4-4bba-9edb-ca6db2cc4295,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3317df18-83') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=3317df18-83e4-4bba-9edb-ca6db2cc4295,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3317df18-83') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3317df18-83, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: INFO os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=3317df18-83e4-4bba-9edb-ca6db2cc4295,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3317df18-83')
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:10:95,bridge_name='br-int',has_traffic_filtering=True,id=cbf96d51-1d93-4bcf-9292-fc6eaa08b461,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbf96d51-1d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:10:95,bridge_name='br-int',has_traffic_filtering=True,id=cbf96d51-1d93-4bcf-9292-fc6eaa08b461,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbf96d51-1d') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbf96d51-1d, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: INFO os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:10:95,bridge_name='br-int',has_traffic_filtering=True,id=cbf96d51-1d93-4bcf-9292-fc6eaa08b461,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbf96d51-1d')
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:b3,bridge_name='br-int',has_traffic_filtering=True,id=515abaa3-8010-44ee-b397-e0858b8a3d3e,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515abaa3-80') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:b3,bridge_name='br-int',has_traffic_filtering=True,id=515abaa3-8010-44ee-b397-e0858b8a3d3e,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515abaa3-80') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap515abaa3-80, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: INFO os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:9d:b3,bridge_name='br-int',has_traffic_filtering=True,id=515abaa3-8010-44ee-b397-e0858b8a3d3e,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515abaa3-80')
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "address": "fa:16:3e:3b:1b:87", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd9f8-3d", "ovs_interfaceid": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "address": "fa:16:3e:3b:1b:87", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd9f8-3d", "ovs_interfaceid": "431bd9f8-3d84-4fd2-a62b-36fc4d7b557f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=431bd9f8-3d84-4fd2-a62b-36fc4d7b557f,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd9f8-3d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=431bd9f8-3d84-4fd2-a62b-36fc4d7b557f,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd9f8-3d') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap431bd9f8-3d, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: INFO os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1b:87,bridge_name='br-int',has_traffic_filtering=True,id=431bd9f8-3d84-4fd2-a62b-36fc4d7b557f,network=Network(800b915d-b296-46df-8606-6d039e87a853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd9f8-3d')
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1b:f8,bridge_name='br-int',has_traffic_filtering=True,id=cfcfd098-0086-428d-80a8-7c7d408afc3e,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfcfd098-00') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1b:f8,bridge_name='br-int',has_traffic_filtering=True,id=cfcfd098-0086-428d-80a8-7c7d408afc3e,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfcfd098-00') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfcfd098-00, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: INFO os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:1b:f8,bridge_name='br-int',has_traffic_filtering=True,id=cfcfd098-0086-428d-80a8-7c7d408afc3e,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfcfd098-00')
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1624093023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1624093023',id=11,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ84nFVcB97oehi8P/5ndZ+Mt/qh9rsFk91glcXLP6DLQF54Rf2ykjfQJ32snOsE0SmL4auSlZ1EZVlgm81JbVtX+mZdwrobjqcApXXAo/sqi3BevjezWZPXtSovw4KAOw==',key_name='tempest-keypair-1788314823',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='185df0487c2245a5a764f2006dec8341',ramdisk_id='',reservation_id='r-atr3i28o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-138235642',owner_user_name='tempest-TaggedBootDevicesTest_v242-138235642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='295b1d8849c64318b96d69a4ce248a9c',uuid=bbab26b4-9515-4427-a01c-04f4a85b1fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converting VIF {"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a8:03,bridge_name='br-int',has_traffic_filtering=True,id=fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd45192c-db') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a8:03,bridge_name='br-int',has_traffic_filtering=True,id=fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd45192c-db') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd45192c-db, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:45:08 user nova-compute[72990]: INFO os_vif [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a8:03,bridge_name='br-int',has_traffic_filtering=True,id=fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c,network=Network(caa06d5a-9db8-41ed-9249-34d1cd0e7e44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd45192c-db')
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlkpVyoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:45:08 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693107893.7747324, a388d657-a11d-4a63-b7fc-2df799ca72d0 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:45:08 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] VM Stopped (Lifecycle Event)
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e92fbd-a954-4070-887e-6efc553097cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG nova.compute.manager [None req-1b394535-1aec-4e80-a2ee-3a1a90704be7 None None] [instance: a388d657-a11d-4a63-b7fc-2df799ca72d0] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4dab7c-80df-4272-b6eb-641dd1100446]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:45:08 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:45:08 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:45:08 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:45:08 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:45:08 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:45:08 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:45:08 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:45:08 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:45:08 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:45:08 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:45:08 user nova-compute[72990]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 (non-flash)
Aug 27 03:45:08 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7144f7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690'): ({'sde'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Removing single pathed devices sde {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee470b70-46bb-49f9-9248-fff64425f8c5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf3d655-4e8e-4114-8c2c-0fc178c51e3b]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Flushing IO for device /dev/sde {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d40f9f-dd9e-4ee5-8696-d3ed5692eb2a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4704f58-8c68-46ed-ab35-13fb3dbfc323]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] SCSI volumes sde have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b390a6-da62-4f18-b50c-cbad24ea8583]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79a8a3e-348c-4963-8fd5-c0514a85aa44]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690, portal: 172.16.0.220,3260]
Aug 27 03:45:09 user nova-compute[72990]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690, portal: 172.16.0.220,3260] successful.
Aug 27 03:45:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:09 user nova-compute[72990]: WARNING nova.compute.manager [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-37ba863e-2224-43c9-8b0e-76d42e1ec9ac for instance with vm_state active and task_state deleting.
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-unplugged-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:09 user nova-compute[72990]: WARNING nova.compute.manager [req-96ef5620-fd83-4242-b4ad-7206c125ee98 req-2d53b05e-693a-4913-94d3-7ad33ac66abb service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f for instance with vm_state active and task_state deleting.
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da19fe0-95d1-4eb9-8979-a525393f2690 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3642bd2d-e66e-4acd-9132-7afc5ef283d0]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] <== disconnect_volume: return (339ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXydBzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:45:09 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f651c73-647c-4879-93dd-1941f6048c87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa79c9af-f239-4de6-aa56-876c8c29732e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:45:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 (non-flash)
Aug 27 03:45:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4486b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1'): ({'sdd'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Removing single pathed devices sdd {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b71d73-fc31-4b81-8be2-82ae5c915e1e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-3317df18-83e4-4bba-9edb-ca6db2cc4295 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-3317df18-83e4-4bba-9edb-ca6db2cc4295 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:09 user nova-compute[72990]: WARNING nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-3317df18-83e4-4bba-9edb-ca6db2cc4295 for instance with vm_state active and task_state deleting.
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-unplugged-515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-515abaa3-8010-44ee-b397-e0858b8a3d3e for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:09 user nova-compute[72990]: WARNING nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-515abaa3-8010-44ee-b397-e0858b8a3d3e for instance with vm_state active and task_state deleting.
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-unplugged-cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-cfcfd098-0086-428d-80a8-7c7d408afc3e for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:09 user nova-compute[72990]: WARNING nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-cfcfd098-0086-428d-80a8-7c7d408afc3e for instance with vm_state active and task_state deleting.
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-unplugged-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-unplugged-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:09 user nova-compute[72990]: WARNING nova.compute.manager [req-f4e60ca4-4d75-47c7-b673-3ef1b90d7225 req-265c245b-328b-4753-94c8-ae4022d477e7 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c for instance with vm_state active and task_state deleting.
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f587b63-868a-4403-937a-b881cb703128]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Flushing IO for device /dev/sdd {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3a2109-7e8a-490e-ba46-f6ad05b735d3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e5fb44-aa10-4371-a797-9b42bf34057a]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28891de-d5a1-45ab-aa94-dc8a4bab2676]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd533113-3b62-4c1e-ae6a-d155cb5e3734]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1, portal: 172.16.0.220,3260]
Aug 27 03:45:09 user nova-compute[72990]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1, portal: 172.16.0.220,3260] successful.
Aug 27 03:45:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ef045-45b3-44d6-bd55-a8bd3472abe1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[389517fd-ade5-4258-9e31-ae8ffd5646e0]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] <== disconnect_volume: return (296ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJSOvjAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:45:09 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[663336c7-8126-49cc-956c-f715eaf75320]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-b0abcf3b-036b-4466-bc07-2d8041219758 req-ccf7a43e-3e1d-4c2c-8bf6-94e23af53b6d service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-plugged-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b0abcf3b-036b-4466-bc07-2d8041219758 req-ccf7a43e-3e1d-4c2c-8bf6-94e23af53b6d service nova] Acquiring lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b0abcf3b-036b-4466-bc07-2d8041219758 req-ccf7a43e-3e1d-4c2c-8bf6-94e23af53b6d service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b0abcf3b-036b-4466-bc07-2d8041219758 req-ccf7a43e-3e1d-4c2c-8bf6-94e23af53b6d service nova] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-b0abcf3b-036b-4466-bc07-2d8041219758 req-ccf7a43e-3e1d-4c2c-8bf6-94e23af53b6d service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] No waiting events found dispatching network-vif-plugged-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:09 user nova-compute[72990]: WARNING nova.compute.manager [req-b0abcf3b-036b-4466-bc07-2d8041219758 req-ccf7a43e-3e1d-4c2c-8bf6-94e23af53b6d service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received unexpected event network-vif-plugged-cbf96d51-1d93-4bcf-9292-fc6eaa08b461 for instance with vm_state active and task_state deleting.
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86a1382-53f0-4d8b-bc0e-66f8bbf5ce34]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:45:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:45:09 user nova-compute[72990]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c (non-flash)
Aug 27 03:45:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4432cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ff5816-1a13-47ad-a601-3bc5f04d7525]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[db444147-4435-4ba8-aa24-01277f818c56]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5638056b-a54e-473c-aa0c-18aa3a7e7a6f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[194e5a6d-a477-4cc1-b2d8-20abea16a7be]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9602d35-fe44-416b-9d62-ed38888c0c0c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1247f165-f289-4eae-83ef-edacec5542b1]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c, portal: 172.16.0.220,3260]
Aug 27 03:45:09 user nova-compute[72990]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c, portal: 172.16.0.220,3260] successful.
Aug 27 03:45:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c79c6f-3849-465f-9826-78c35675890c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9203f9ef-d8f5-4853-a729-c1b7f2a2f2a2]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] <== disconnect_volume: return (316ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:45:09 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Deleting instance files /opt/stack/data/nova/instances/bbab26b4-9515-4427-a01c-04f4a85b1fa8_del
Aug 27 03:45:09 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Deletion of /opt/stack/data/nova/instances/bbab26b4-9515-4427-a01c-04f4a85b1fa8_del complete
Aug 27 03:45:09 user nova-compute[72990]: INFO nova.compute.manager [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Took 3.18 seconds to destroy the instance on the hypervisor.
Aug 27 03:45:09 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:45:09 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:45:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-c5c719f8-e51a-4089-9714-6e27a15d9985 req-691accc1-c33d-49d9-b96d-307545f2b87a service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-deleted-431bd9f8-3d84-4fd2-a62b-36fc4d7b557f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:11 user nova-compute[72990]: INFO nova.compute.manager [req-c5c719f8-e51a-4089-9714-6e27a15d9985 req-691accc1-c33d-49d9-b96d-307545f2b87a service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Neutron deleted interface 431bd9f8-3d84-4fd2-a62b-36fc4d7b557f; detaching it from the instance and deleting it from the info cache
Aug 27 03:45:11 user nova-compute[72990]: DEBUG nova.network.neutron [req-c5c719f8-e51a-4089-9714-6e27a15d9985 req-691accc1-c33d-49d9-b96d-307545f2b87a service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating instance_info_cache with network_info: [{"id": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "address": "fa:16:3e:53:d1:99", "network": {"id": "313da542-8e92-4faa-92ed-8d52cd21e2f4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-735911235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ba863e-22", "ovs_interfaceid": "37ba863e-2224-43c9-8b0e-76d42e1ec9ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:45:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-c5c719f8-e51a-4089-9714-6e27a15d9985 req-691accc1-c33d-49d9-b96d-307545f2b87a service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Detach interface failed, port_id=431bd9f8-3d84-4fd2-a62b-36fc4d7b557f, reason: Instance bbab26b4-9515-4427-a01c-04f4a85b1fa8 could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:45:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:13 user nova-compute[72990]: INFO nova.compute.manager [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Rescuing
Aug 27 03:45:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:45:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquired lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:45:13 user nova-compute[72990]: DEBUG nova.network.neutron [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:45:13 user nova-compute[72990]: INFO nova.compute.manager [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Rescuing
Aug 27 03:45:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:45:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquired lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:45:13 user nova-compute[72990]: DEBUG nova.network.neutron [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:45:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-8bbf5795-08a7-4a5e-9179-6734facf44dc req-f76e09e9-5063-496d-a562-8cc98d70bbf3 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-deleted-37ba863e-2224-43c9-8b0e-76d42e1ec9ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:13 user nova-compute[72990]: INFO nova.compute.manager [req-8bbf5795-08a7-4a5e-9179-6734facf44dc req-f76e09e9-5063-496d-a562-8cc98d70bbf3 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Neutron deleted interface 37ba863e-2224-43c9-8b0e-76d42e1ec9ac; detaching it from the instance and deleting it from the info cache
Aug 27 03:45:13 user nova-compute[72990]: DEBUG nova.network.neutron [req-8bbf5795-08a7-4a5e-9179-6734facf44dc req-f76e09e9-5063-496d-a562-8cc98d70bbf3 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating instance_info_cache with network_info: [{"id": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "address": "fa:16:3e:9a:1a:4f", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3317df18-83", "ovs_interfaceid": "3317df18-83e4-4bba-9edb-ca6db2cc4295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "address": "fa:16:3e:cf:10:95", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf96d51-1d", "ovs_interfaceid": "cbf96d51-1d93-4bcf-9292-fc6eaa08b461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "address": "fa:16:3e:02:9d:b3", "network": {"id": "800b915d-b296-46df-8606-6d039e87a853", "bridge": "br-int", "label": "tempest-device-tagging-net1-1665910181", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515abaa3-80", "ovs_interfaceid": "515abaa3-8010-44ee-b397-e0858b8a3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "address": "fa:16:3e:9a:1b:f8", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfcfd098-00", "ovs_interfaceid": "cfcfd098-0086-428d-80a8-7c7d408afc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "address": "fa:16:3e:f1:a8:03", "network": {"id": "caa06d5a-9db8-41ed-9249-34d1cd0e7e44", "bridge": "br-int", "label": "tempest-device-tagging-net2-1864840267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "185df0487c2245a5a764f2006dec8341", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd45192c-db", "ovs_interfaceid": "fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:45:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-8bbf5795-08a7-4a5e-9179-6734facf44dc req-f76e09e9-5063-496d-a562-8cc98d70bbf3 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Detach interface failed, port_id=37ba863e-2224-43c9-8b0e-76d42e1ec9ac, reason: Instance bbab26b4-9515-4427-a01c-04f4a85b1fa8 could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG nova.network.neutron [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Updating instance_info_cache with network_info: [{"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Releasing lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG nova.network.neutron [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Updating instance_info_cache with network_info: [{"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Releasing lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-55b78ec6-a8b2-4c84-9399-fd7bdb152f5a req-15e7d8b2-10fb-4e6a-8388-af599b65c72d service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-unplugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-55b78ec6-a8b2-4c84-9399-fd7bdb152f5a req-15e7d8b2-10fb-4e6a-8388-af599b65c72d service nova] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-55b78ec6-a8b2-4c84-9399-fd7bdb152f5a req-15e7d8b2-10fb-4e6a-8388-af599b65c72d service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-55b78ec6-a8b2-4c84-9399-fd7bdb152f5a req-15e7d8b2-10fb-4e6a-8388-af599b65c72d service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-55b78ec6-a8b2-4c84-9399-fd7bdb152f5a req-15e7d8b2-10fb-4e6a-8388-af599b65c72d service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] No waiting events found dispatching network-vif-unplugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:14 user nova-compute[72990]: WARNING nova.compute.manager [req-55b78ec6-a8b2-4c84-9399-fd7bdb152f5a req-15e7d8b2-10fb-4e6a-8388-af599b65c72d service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received unexpected event network-vif-unplugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 for instance with vm_state active and task_state rescuing.
Aug 27 03:45:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: ca203604-996d-4558-9857-df9e2001c319] Instance destroyed successfully.
Aug 27 03:45:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Attempting rescue
Aug 27 03:45:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72990) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Instance directory exists: not creating {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 03:45:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Creating image(s)
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "/opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "/opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG nova.objects.instance [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'trusted_certs' on Instance uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-e1586cf9-6008-43ce-88ea-a6eb0f3d6c29 req-f7803cb8-11f8-45d8-ad92-22831c01a4aa service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-unplugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e1586cf9-6008-43ce-88ea-a6eb0f3d6c29 req-f7803cb8-11f8-45d8-ad92-22831c01a4aa service nova] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e1586cf9-6008-43ce-88ea-a6eb0f3d6c29 req-f7803cb8-11f8-45d8-ad92-22831c01a4aa service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e1586cf9-6008-43ce-88ea-a6eb0f3d6c29 req-f7803cb8-11f8-45d8-ad92-22831c01a4aa service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-e1586cf9-6008-43ce-88ea-a6eb0f3d6c29 req-f7803cb8-11f8-45d8-ad92-22831c01a4aa service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] No waiting events found dispatching network-vif-unplugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:14 user nova-compute[72990]: WARNING nova.compute.manager [req-e1586cf9-6008-43ce-88ea-a6eb0f3d6c29 req-f7803cb8-11f8-45d8-ad92-22831c01a4aa service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received unexpected event network-vif-unplugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 for instance with vm_state active and task_state rescuing.
Aug 27 03:45:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.264s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.rescue {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.rescue" returned: 0 in 0.050s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.objects.instance [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'migration_context' on Instance uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.objects.base [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<ca203604-996d-4558-9857-df9e2001c319> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Start _get_guest_xml network_info=[{"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "vif_mac": "fa:16:3e:3c:66:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.objects.instance [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'resources' on Instance uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.objects.base [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<ca203604-996d-4558-9857-df9e2001c319> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.objects.instance [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'numa_topology' on Instance uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.objects.base [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<ca203604-996d-4558-9857-df9e2001c319> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:45:15 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:45:15 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.objects.instance [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.objects.base [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<ca203604-996d-4558-9857-df9e2001c319> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1768289849',display_name='tempest-ServerRescueNegativeTestJSON-server-1768289849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1768289849',id=1,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='567ed48c72c547c6984851d6ba37e780',ramdisk_id='',reservation_id='r-nlz0jlc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-311406621',owner_user_name='tempest-ServerRescueNegativeTestJSON-311406621-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:40:41Z,user_data=None,user_id='f0631ab8ad8648e2912d4e554fbbe195',uuid=ca203604-996d-4558-9857-df9e2001c319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "vif_mac": "fa:16:3e:3c:66:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converting VIF {"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "vif_mac": "fa:16:3e:3c:66:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:66:7d,bridge_name='br-int',has_traffic_filtering=True,id=372aa0cf-2e3f-47db-a433-7ed673f37dd0,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372aa0cf-2e') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.objects.instance [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'pci_devices' on Instance uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:45:15 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Instance destroyed successfully.
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.objects.base [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<ca203604-996d-4558-9857-df9e2001c319> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:45:15 user nova-compute[72990]:   <uuid>ca203604-996d-4558-9857-df9e2001c319</uuid>
Aug 27 03:45:15 user nova-compute[72990]:   <name>instance-00000001</name>
Aug 27 03:45:15 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:45:15 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:45:15 user nova-compute[72990]:   <metadata>
Aug 27 03:45:15 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:45:15 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:45:15 user nova-compute[72990]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1768289849</nova:name>
Aug 27 03:45:15 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:45:15</nova:creationTime>
Aug 27 03:45:15 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:45:15 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:45:15 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:45:15 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:45:15 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:45:15 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:45:15 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:45:15 user nova-compute[72990]:       <nova:owner>
Aug 27 03:45:15 user nova-compute[72990]:         <nova:user uuid="f0631ab8ad8648e2912d4e554fbbe195">tempest-ServerRescueNegativeTestJSON-311406621-project-member</nova:user>
Aug 27 03:45:15 user nova-compute[72990]:         <nova:project uuid="567ed48c72c547c6984851d6ba37e780">tempest-ServerRescueNegativeTestJSON-311406621</nova:project>
Aug 27 03:45:15 user nova-compute[72990]:       </nova:owner>
Aug 27 03:45:15 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:45:15 user nova-compute[72990]:       <nova:ports>
Aug 27 03:45:15 user nova-compute[72990]:         <nova:port uuid="372aa0cf-2e3f-47db-a433-7ed673f37dd0">
Aug 27 03:45:15 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 03:45:15 user nova-compute[72990]:         </nova:port>
Aug 27 03:45:15 user nova-compute[72990]:       </nova:ports>
Aug 27 03:45:15 user nova-compute[72990]:     </nova:instance>
Aug 27 03:45:15 user nova-compute[72990]:   </metadata>
Aug 27 03:45:15 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:45:15 user nova-compute[72990]:     <system>
Aug 27 03:45:15 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:45:15 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:45:15 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:45:15 user nova-compute[72990]:       <entry name="serial">ca203604-996d-4558-9857-df9e2001c319</entry>
Aug 27 03:45:15 user nova-compute[72990]:       <entry name="uuid">ca203604-996d-4558-9857-df9e2001c319</entry>
Aug 27 03:45:15 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:45:15 user nova-compute[72990]:     </system>
Aug 27 03:45:15 user nova-compute[72990]:   </sysinfo>
Aug 27 03:45:15 user nova-compute[72990]:   <os>
Aug 27 03:45:15 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:45:15 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:45:15 user nova-compute[72990]:   </os>
Aug 27 03:45:15 user nova-compute[72990]:   <features>
Aug 27 03:45:15 user nova-compute[72990]:     <acpi/>
Aug 27 03:45:15 user nova-compute[72990]:     <apic/>
Aug 27 03:45:15 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:45:15 user nova-compute[72990]:   </features>
Aug 27 03:45:15 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:45:15 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:45:15 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:45:15 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:45:15 user nova-compute[72990]:   </clock>
Aug 27 03:45:15 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:45:15 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:45:15 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:45:15 user nova-compute[72990]:   </cpu>
Aug 27 03:45:15 user nova-compute[72990]:   <devices>
Aug 27 03:45:15 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:45:15 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:45:15 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.rescue"/>
Aug 27 03:45:15 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:45:15 user nova-compute[72990]:     </disk>
Aug 27 03:45:15 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:45:15 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:45:15 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk"/>
Aug 27 03:45:15 user nova-compute[72990]:       <target dev="vdb" bus="virtio"/>
Aug 27 03:45:15 user nova-compute[72990]:     </disk>
Aug 27 03:45:15 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:45:15 user nova-compute[72990]:       <mac address="fa:16:3e:3c:66:7d"/>
Aug 27 03:45:15 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:45:15 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:45:15 user nova-compute[72990]:       <target dev="tap372aa0cf-2e"/>
Aug 27 03:45:15 user nova-compute[72990]:     </interface>
Aug 27 03:45:15 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:45:15 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/console.log" append="off"/>
Aug 27 03:45:15 user nova-compute[72990]:     </serial>
Aug 27 03:45:15 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:45:15 user nova-compute[72990]:     <video>
Aug 27 03:45:15 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:45:15 user nova-compute[72990]:     </video>
Aug 27 03:45:15 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:45:15 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:45:15 user nova-compute[72990]:     </rng>
Aug 27 03:45:15 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:45:15 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:45:15 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:45:15 user nova-compute[72990]:     </memballoon>
Aug 27 03:45:15 user nova-compute[72990]:   </devices>
Aug 27 03:45:15 user nova-compute[72990]: </domain>
Aug 27 03:45:15 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:45:15 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Took 5.51 seconds to deallocate network for instance.
Aug 27 03:45:15 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Attempting a stable device rescue
Aug 27 03:45:15 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: ca203604-996d-4558-9857-df9e2001c319] Instance destroyed successfully.
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72990) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Instance directory exists: not creating {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 03:45:15 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Creating image(s)
Aug 27 03:45:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "/opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "/opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "/opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7114903d-465a-4ef6-b436-88af52261eae {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "73b53ba28feb0326a1ad08448642a163600f9c5e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "73b53ba28feb0326a1ad08448642a163600f9c5e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:45:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No VIF found with MAC fa:16:3e:3c:66:7d, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e.part --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-ee690749-73b2-4621-880f-44335f0aa9b5 req-869eb90d-f9c1-4627-9ac2-591b841f9673 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-deleted-cfcfd098-0086-428d-80a8-7c7d408afc3e {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-ee690749-73b2-4621-880f-44335f0aa9b5 req-869eb90d-f9c1-4627-9ac2-591b841f9673 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-deleted-fd45192c-dbb0-4ab6-bc1d-0f56fa59b88c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-ee690749-73b2-4621-880f-44335f0aa9b5 req-869eb90d-f9c1-4627-9ac2-591b841f9673 service nova] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Received event network-vif-deleted-515abaa3-8010-44ee-b397-e0858b8a3d3e {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-d6526b72-ec62-441f-bfbc-1a7a5d381ac4 req-ef82c127-1ca0-424c-9cf3-d657c621603e service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d6526b72-ec62-441f-bfbc-1a7a5d381ac4 req-ef82c127-1ca0-424c-9cf3-d657c621603e service nova] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d6526b72-ec62-441f-bfbc-1a7a5d381ac4 req-ef82c127-1ca0-424c-9cf3-d657c621603e service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d6526b72-ec62-441f-bfbc-1a7a5d381ac4 req-ef82c127-1ca0-424c-9cf3-d657c621603e service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-d6526b72-ec62-441f-bfbc-1a7a5d381ac4 req-ef82c127-1ca0-424c-9cf3-d657c621603e service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] No waiting events found dispatching network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:16 user nova-compute[72990]: WARNING nova.compute.manager [req-d6526b72-ec62-441f-bfbc-1a7a5d381ac4 req-ef82c127-1ca0-424c-9cf3-d657c621603e service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received unexpected event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 for instance with vm_state active and task_state rescuing.
Aug 27 03:45:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-ab04c804-b9c9-4b21-afe9-bb2b8f2a3565 req-f069efbb-ad30-4a25-ab56-ce7660a40e7e service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ab04c804-b9c9-4b21-afe9-bb2b8f2a3565 req-f069efbb-ad30-4a25-ab56-ce7660a40e7e service nova] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ab04c804-b9c9-4b21-afe9-bb2b8f2a3565 req-f069efbb-ad30-4a25-ab56-ce7660a40e7e service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ab04c804-b9c9-4b21-afe9-bb2b8f2a3565 req-f069efbb-ad30-4a25-ab56-ce7660a40e7e service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-ab04c804-b9c9-4b21-afe9-bb2b8f2a3565 req-f069efbb-ad30-4a25-ab56-ce7660a40e7e service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] No waiting events found dispatching network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:16 user nova-compute[72990]: WARNING nova.compute.manager [req-ab04c804-b9c9-4b21-afe9-bb2b8f2a3565 req-f069efbb-ad30-4a25-ab56-ce7660a40e7e service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received unexpected event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 for instance with vm_state active and task_state rescuing.
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e.part --force-share --output=json" returned: 0 in 0.195s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG nova.virt.images [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] 74fa35f9-f8fe-4da0-a65c-6f1280d15992 was qcow2, converting to raw {{(pid=72990) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e.part /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e.converted {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e.part /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e.converted" returned: 0 in 0.470s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e.converted --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "73b53ba28feb0326a1ad08448642a163600f9c5e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.313s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "73b53ba28feb0326a1ad08448642a163600f9c5e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "73b53ba28feb0326a1ad08448642a163600f9c5e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e --force-share --output=json" returned: 0 in 0.202s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e,backing_fmt=raw /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.rescue {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e,backing_fmt=raw /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.rescue" returned: 0 in 0.052s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "73b53ba28feb0326a1ad08448642a163600f9c5e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'migration_context' on Instance uuid 7114903d-465a-4ef6-b436-88af52261eae {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG nova.objects.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Object Instance<7114903d-465a-4ef6-b436-88af52261eae> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:45:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Start _get_guest_xml network_info=[{"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "vif_mac": "fa:16:3e:75:99:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '74fa35f9-f8fe-4da0-a65c-6f1280d15992', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'f8c99d31-1d5e-4ba1-8b3e-69d27b6b3aea', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxIRKtmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '7114903d-465a-4ef6-b436-88af52261eae', 'attached_at': '', 'detached_at': '', 'volume_id': '22ce017c-edc6-4e54-bed5-792dc4e365f5', 'serial': '22ce017c-edc6-4e54-bed5-792dc4e365f5'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'resources' on Instance uuid 7114903d-465a-4ef6-b436-88af52261eae {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.objects.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Object Instance<7114903d-465a-4ef6-b436-88af52261eae> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'numa_topology' on Instance uuid 7114903d-465a-4ef6-b436-88af52261eae {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.objects.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Object Instance<7114903d-465a-4ef6-b436-88af52261eae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:45:18 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:45:18 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7114903d-465a-4ef6-b436-88af52261eae {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.objects.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Object Instance<7114903d-465a-4ef6-b436-88af52261eae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxIRKtmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:45:18 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:45:18 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:45:18 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d6bf79-129a-445e-a7e6-b4c1a1841d89]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = FxIRKtmV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 03:45:18 user nova-compute[72990]: node.name = iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5
Aug 27 03:45:18 user nova-compute[72990]: node.tpgt = -1
Aug 27 03:45:18 user nova-compute[72990]: node.startup = automatic
Aug 27 03:45:18 user nova-compute[72990]: node.leading_login = No
Aug 27 03:45:18 user nova-compute[72990]: iface.iscsi_ifacename = default
Aug 27 03:45:18 user nova-compute[72990]: iface.net_ifacename = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.ipaddress = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.prefix_len = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.hwaddress = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.transport_name = tcp
Aug 27 03:45:18 user nova-compute[72990]: iface.initiatorname = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.state = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.vlan_id = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.vlan_priority = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.vlan_state = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.iface_num = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.mtu = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.port = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.bootproto = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.subnet_mask = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.gateway = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.dhcp_alt_client_id = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.dhcp_dns = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.dhcp_learn_iqn = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.dhcp_vendor_id_state = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.dhcp_vendor_id = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.dhcp_slp_da = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.fragmentation = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.gratuitous_arp = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.incoming_forwarding = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.tos_state = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.tos = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.ttl = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.delayed_ack = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.tcp_nagle = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.tcp_wsf_state = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.tcp_wsf = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.tcp_timer_scale = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.tcp_timestamp = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.redirect = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.def_task_mgmt_timeout = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.header_digest = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.data_digest = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.immediate_data = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.initial_r2t = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.data_seq_inorder = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.data_pdu_inorder = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.erl = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.max_receive_data_len = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.first_burst_len = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.max_outstanding_r2t = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.max_burst_len = 0
Aug 27 03:45:18 user nova-compute[72990]: iface.chap_auth = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.bidi_chap = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.strict_login_compliance = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.discovery_auth = <empty>
Aug 27 03:45:18 user nova-compute[72990]: iface.discovery_logout = <empty>
Aug 27 03:45:18 user nova-compute[72990]: node.discovery_address = <empty>
Aug 27 03:45:18 user nova-compute[72990]: node.discovery_port = 0
Aug 27 03:45:18 user nova-compute[72990]: node.discovery_type = static
Aug 27 03:45:18 user nova-compute[72990]: node.session.initial_cmdsn = 0
Aug 27 03:45:18 user nova-compute[72990]: node.session.initial_login_retry_max = 8
Aug 27 03:45:18 user nova-compute[72990]: node.session.xmit_thread_priority = -20
Aug 27 03:45:18 user nova-compute[72990]: node.session.cmds_max = 128
Aug 27 03:45:18 user nova-compute[72990]: node.session.queue_depth = 32
Aug 27 03:45:18 user nova-compute[72990]: node.session.nr_sessions = 1
Aug 27 03:45:18 user nova-compute[72990]: node.session.auth.authmethod = CHAP
Aug 27 03:45:18 user nova-compute[72990]: node.session.auth.username = FxIRKtmV
Aug 27 03:45:18 user nova-compute[72990]: node.session.auth.password = ***
Aug 27 03:45:18 user nova-compute[72990]: node.session.auth.username_in = <empty>
Aug 27 03:45:18 user nova-compute[72990]: node.session.auth.password_in = <empty>
Aug 27 03:45:18 user nova-compute[72990]: node.session.auth.chap_algs = MD5
Aug 27 03:45:18 user nova-compute[72990]: node.session.timeo.replacement_timeout = 120
Aug 27 03:45:18 user nova-compute[72990]: node.session.err_timeo.abort_timeout = 15
Aug 27 03:45:18 user nova-compute[72990]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 03:45:18 user nova-compute[72990]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 03:45:18 user nova-compute[72990]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 03:45:18 user nova-compute[72990]: node.session.iscsi.FastAbort = Yes
Aug 27 03:45:18 user nova-compute[72990]: node.session.iscsi.InitialR2T = No
Aug 27 03:45:18 user nova-compute[72990]: node.session.iscsi.ImmediateData = Yes
Aug 27 03:45:18 user nova-compute[72990]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 03:45:18 user nova-compute[72990]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 03:45:18 user nova-compute[72990]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 03:45:18 user nova-compute[72990]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 03:45:18 user nova-compute[72990]: node.session.iscsi.MaxConnections = 1
Aug 27 03:45:18 user nova-compute[72990]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 03:45:18 user nova-compute[72990]: node.session.iscsi.ERL = 0
Aug 27 03:45:18 user nova-compute[72990]: node.session.scan = manual
Aug 27 03:45:18 user nova-compute[72990]: node.session.reopen_max = 0
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].address = 172.16.0.220
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].port = 3260
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].startup = manual
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].tcp.window_size = 524288
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].tcp.type_of_service = 0
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].timeo.logout_timeout = 15
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].timeo.login_timeout = 15
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].timeo.auth_timeout = 45
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].iscsi.DataDigest = None
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].iscsi.IFMarker = No
Aug 27 03:45:18 user nova-compute[72990]: node.conn[0].iscsi.OFMarker = No
Aug 27 03:45:18 user nova-compute[72990]: # END RECORD
Aug 27 03:45:18 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1f6ecc-36ac-44a7-8424-b68d22ff8bf6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc04f41-27fd-47c9-af62-706f6741b9a8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxIRKtmV {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxIRKtmV" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeea2da-7d5f-435b-a744-ff43cec30e52]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FxIRKtmV'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c59c6b-6ef7-4ca2-8bb7-3a604972e792]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[df22e851-4c14-4359-9678-19867d9dbc8c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:45:18 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:45:18 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:45:18 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:45:18 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:45:18 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:45:18 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] HCTL ('37', '0', '0', 0) found on session 11 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.109s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20f4510-67d8-41d9-9b0e-9fb9b8e20c64]: (4, ('0 0 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching for a device in session 11 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxIRKtmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.268s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] <== connect_volume: return (269ms) {'type': 'block', 'scsi_wwn': '23166653731653864', 'path': '/dev/sdf'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166653731653864', 'path': '/dev/sdf'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334572128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-334572128',id=13,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:43:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-qru8dfhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:43:48Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=7114903d-465a-4ef6-b436-88af52261eae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "vif_mac": "fa:16:3e:75:99:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "vif_mac": "fa:16:3e:75:99:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:99:66,bridge_name='br-int',has_traffic_filtering=True,id=8bd721fc-ebab-49ab-9c7d-f900107b74b2,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd721fc-eb') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'pci_devices' on Instance uuid 7114903d-465a-4ef6-b436-88af52261eae {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.objects.base [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Object Instance<7114903d-465a-4ef6-b436-88af52261eae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:45:18 user nova-compute[72990]:   <uuid>7114903d-465a-4ef6-b436-88af52261eae</uuid>
Aug 27 03:45:18 user nova-compute[72990]:   <name>instance-0000000d</name>
Aug 27 03:45:18 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:45:18 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:45:18 user nova-compute[72990]:   <metadata>
Aug 27 03:45:18 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:45:18 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:45:18 user nova-compute[72990]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-334572128</nova:name>
Aug 27 03:45:18 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:45:18</nova:creationTime>
Aug 27 03:45:18 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:45:18 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:45:18 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:45:18 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:45:18 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:45:18 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:45:18 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:45:18 user nova-compute[72990]:       <nova:owner>
Aug 27 03:45:18 user nova-compute[72990]:         <nova:user uuid="858a63e8d5964f38ad776985cfbe9121">tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member</nova:user>
Aug 27 03:45:18 user nova-compute[72990]:         <nova:project uuid="183297ba5b6549fdb39f2135d92b3794">tempest-ServerBootFromVolumeStableRescueTest-1839224225</nova:project>
Aug 27 03:45:18 user nova-compute[72990]:       </nova:owner>
Aug 27 03:45:18 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:45:18 user nova-compute[72990]:       <nova:ports>
Aug 27 03:45:18 user nova-compute[72990]:         <nova:port uuid="8bd721fc-ebab-49ab-9c7d-f900107b74b2">
Aug 27 03:45:18 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 03:45:18 user nova-compute[72990]:         </nova:port>
Aug 27 03:45:18 user nova-compute[72990]:       </nova:ports>
Aug 27 03:45:18 user nova-compute[72990]:     </nova:instance>
Aug 27 03:45:18 user nova-compute[72990]:   </metadata>
Aug 27 03:45:18 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:45:18 user nova-compute[72990]:     <system>
Aug 27 03:45:18 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:45:18 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:45:18 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:45:18 user nova-compute[72990]:       <entry name="serial">7114903d-465a-4ef6-b436-88af52261eae</entry>
Aug 27 03:45:18 user nova-compute[72990]:       <entry name="uuid">7114903d-465a-4ef6-b436-88af52261eae</entry>
Aug 27 03:45:18 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:45:18 user nova-compute[72990]:     </system>
Aug 27 03:45:18 user nova-compute[72990]:   </sysinfo>
Aug 27 03:45:18 user nova-compute[72990]:   <os>
Aug 27 03:45:18 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:45:18 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:45:18 user nova-compute[72990]:   </os>
Aug 27 03:45:18 user nova-compute[72990]:   <features>
Aug 27 03:45:18 user nova-compute[72990]:     <acpi/>
Aug 27 03:45:18 user nova-compute[72990]:     <apic/>
Aug 27 03:45:18 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:45:18 user nova-compute[72990]:   </features>
Aug 27 03:45:18 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:45:18 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:45:18 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:45:18 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:45:18 user nova-compute[72990]:   </clock>
Aug 27 03:45:18 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:45:18 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:45:18 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:45:18 user nova-compute[72990]:   </cpu>
Aug 27 03:45:18 user nova-compute[72990]:   <devices>
Aug 27 03:45:18 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:45:18 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:45:18 user nova-compute[72990]:       <source dev="/dev/sdf"/>
Aug 27 03:45:18 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:45:18 user nova-compute[72990]:       <serial>22ce017c-edc6-4e54-bed5-792dc4e365f5</serial>
Aug 27 03:45:18 user nova-compute[72990]:     </disk>
Aug 27 03:45:18 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:45:18 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:45:18 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.rescue"/>
Aug 27 03:45:18 user nova-compute[72990]:       <target dev="vdb" bus="virtio"/>
Aug 27 03:45:18 user nova-compute[72990]:       <boot order="1"/>
Aug 27 03:45:18 user nova-compute[72990]:     </disk>
Aug 27 03:45:18 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:45:18 user nova-compute[72990]:       <mac address="fa:16:3e:75:99:66"/>
Aug 27 03:45:18 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:45:18 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:45:18 user nova-compute[72990]:       <target dev="tap8bd721fc-eb"/>
Aug 27 03:45:18 user nova-compute[72990]:     </interface>
Aug 27 03:45:18 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:45:18 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/console.log" append="off"/>
Aug 27 03:45:18 user nova-compute[72990]:     </serial>
Aug 27 03:45:18 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:45:18 user nova-compute[72990]:     <video>
Aug 27 03:45:18 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:45:18 user nova-compute[72990]:     </video>
Aug 27 03:45:18 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:45:18 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:45:18 user nova-compute[72990]:     </rng>
Aug 27 03:45:18 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:45:18 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:45:18 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:45:18 user nova-compute[72990]:     </memballoon>
Aug 27 03:45:18 user nova-compute[72990]:   </devices>
Aug 27 03:45:18 user nova-compute[72990]: </domain>
Aug 27 03:45:18 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:45:18 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Instance destroyed successfully.
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No VIF found with MAC fa:16:3e:75:99:66, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:45:18 user nova-compute[72990]: INFO nova.compute.manager [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Took 3.33 seconds to detach 3 volumes for instance.
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.compute.manager [req-83b2001a-a1c7-40b2-a040-e63ee3695c61 req-92f2cd0e-9d3d-4931-b10c-10c1375bb865 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-83b2001a-a1c7-40b2-a040-e63ee3695c61 req-92f2cd0e-9d3d-4931-b10c-10c1375bb865 service nova] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-83b2001a-a1c7-40b2-a040-e63ee3695c61 req-92f2cd0e-9d3d-4931-b10c-10c1375bb865 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-83b2001a-a1c7-40b2-a040-e63ee3695c61 req-92f2cd0e-9d3d-4931-b10c-10c1375bb865 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.compute.manager [req-83b2001a-a1c7-40b2-a040-e63ee3695c61 req-92f2cd0e-9d3d-4931-b10c-10c1375bb865 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] No waiting events found dispatching network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:18 user nova-compute[72990]: WARNING nova.compute.manager [req-83b2001a-a1c7-40b2-a040-e63ee3695c61 req-92f2cd0e-9d3d-4931-b10c-10c1375bb865 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received unexpected event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 for instance with vm_state active and task_state rescuing.
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.compute.manager [req-83b2001a-a1c7-40b2-a040-e63ee3695c61 req-92f2cd0e-9d3d-4931-b10c-10c1375bb865 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-83b2001a-a1c7-40b2-a040-e63ee3695c61 req-92f2cd0e-9d3d-4931-b10c-10c1375bb865 service nova] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-83b2001a-a1c7-40b2-a040-e63ee3695c61 req-92f2cd0e-9d3d-4931-b10c-10c1375bb865 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-83b2001a-a1c7-40b2-a040-e63ee3695c61 req-92f2cd0e-9d3d-4931-b10c-10c1375bb865 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG nova.compute.manager [req-83b2001a-a1c7-40b2-a040-e63ee3695c61 req-92f2cd0e-9d3d-4931-b10c-10c1375bb865 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] No waiting events found dispatching network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:18 user nova-compute[72990]: WARNING nova.compute.manager [req-83b2001a-a1c7-40b2-a040-e63ee3695c61 req-92f2cd0e-9d3d-4931-b10c-10c1375bb865 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received unexpected event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 for instance with vm_state active and task_state rescuing.
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:19 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:45:19 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:45:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:19 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Deleted allocations for instance bbab26b4-9515-4427-a01c-04f4a85b1fa8
Aug 27 03:45:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6509f782-086b-415d-bbf3-b9d5a313bbd0 tempest-TaggedBootDevicesTest_v242-138235642 tempest-TaggedBootDevicesTest_v242-138235642-project-member] Lock "bbab26b4-9515-4427-a01c-04f4a85b1fa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.709s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:19 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Removed pending event for ca203604-996d-4558-9857-df9e2001c319 due to event {{(pid=72990) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 03:45:19 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107919.696068, ca203604-996d-4558-9857-df9e2001c319 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:45:19 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] VM Resumed (Lifecycle Event)
Aug 27 03:45:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-30fa6133-39a1-493e-a621-1a3f2657bd63 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:45:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:45:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:45:19 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 03:45:19 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107919.69899, ca203604-996d-4558-9857-df9e2001c319 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:45:19 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] VM Started (Lifecycle Event)
Aug 27 03:45:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:45:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:45:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:20 user nova-compute[72990]: DEBUG nova.compute.manager [req-458425fd-e91c-4559-a6fa-5ae30523b760 req-a9a6829f-e947-40ea-b8c4-8c9b8eaeedc3 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-458425fd-e91c-4559-a6fa-5ae30523b760 req-a9a6829f-e947-40ea-b8c4-8c9b8eaeedc3 service nova] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-458425fd-e91c-4559-a6fa-5ae30523b760 req-a9a6829f-e947-40ea-b8c4-8c9b8eaeedc3 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-458425fd-e91c-4559-a6fa-5ae30523b760 req-a9a6829f-e947-40ea-b8c4-8c9b8eaeedc3 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:20 user nova-compute[72990]: DEBUG nova.compute.manager [req-458425fd-e91c-4559-a6fa-5ae30523b760 req-a9a6829f-e947-40ea-b8c4-8c9b8eaeedc3 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] No waiting events found dispatching network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:20 user nova-compute[72990]: WARNING nova.compute.manager [req-458425fd-e91c-4559-a6fa-5ae30523b760 req-a9a6829f-e947-40ea-b8c4-8c9b8eaeedc3 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received unexpected event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 for instance with vm_state active and task_state rescuing.
Aug 27 03:45:20 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:45:21 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:45:21 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:45:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:45:21 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:45:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:21 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG nova.compute.manager [req-d295ad45-01d9-4546-b213-2dc499a2de8b req-bec34a56-6d30-44d9-ae61-d3efab63e0e4 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d295ad45-01d9-4546-b213-2dc499a2de8b req-bec34a56-6d30-44d9-ae61-d3efab63e0e4 service nova] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d295ad45-01d9-4546-b213-2dc499a2de8b req-bec34a56-6d30-44d9-ae61-d3efab63e0e4 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d295ad45-01d9-4546-b213-2dc499a2de8b req-bec34a56-6d30-44d9-ae61-d3efab63e0e4 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG nova.compute.manager [req-d295ad45-01d9-4546-b213-2dc499a2de8b req-bec34a56-6d30-44d9-ae61-d3efab63e0e4 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] No waiting events found dispatching network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:22 user nova-compute[72990]: WARNING nova.compute.manager [req-d295ad45-01d9-4546-b213-2dc499a2de8b req-bec34a56-6d30-44d9-ae61-d3efab63e0e4 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received unexpected event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 for instance with vm_state active and task_state rescuing.
Aug 27 03:45:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Removed pending event for 7114903d-465a-4ef6-b436-88af52261eae due to event {{(pid=72990) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107922.3081996, 7114903d-465a-4ef6-b436-88af52261eae => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:45:22 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] VM Resumed (Lifecycle Event)
Aug 27 03:45:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9d6088b3-292b-426c-b61e-d6a3daf56a36 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:45:22 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 03:45:22 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107922.3141224, 7114903d-465a-4ef6-b436-88af52261eae => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:45:22 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] VM Started (Lifecycle Event)
Aug 27 03:45:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:45:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:23 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693107908.3803935, bbab26b4-9515-4427-a01c-04f4a85b1fa8 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:45:23 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] VM Stopped (Lifecycle Event)
Aug 27 03:45:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-e8297a23-dee2-4168-b34a-d21712d8646a None None] [instance: bbab26b4-9515-4427-a01c-04f4a85b1fa8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:45:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:45:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:45:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.rescue --force-share --output=json" returned: 0 in 0.330s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:29 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:45:29 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7262MB free_disk=25.2652587890625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 970ca110-30d7-4e41-92d3-aa4e0bda4482 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bc82cced-9f16-44bc-b9bc-622fa99b1be0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ed1742b9-a19d-43f9-b39a-7257261f858c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 1e81de88-259e-4124-8e2c-cafd310a9b42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:45:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:30 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:45:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:45:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:45:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:45:31 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:45:31 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updating instance_info_cache with network_info: [{"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:45:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:45:31 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:45:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:45:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:45:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:45:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:38 user nova-compute[72990]: INFO nova.compute.manager [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Detaching volume d4903dc3-968e-4c23-8ea2-a6f69be45ad1
Aug 27 03:45:38 user nova-compute[72990]: INFO nova.virt.block_device [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Attempting to driver detach volume d4903dc3-968e-4c23-8ea2-a6f69be45ad1 from mountpoint /dev/vdb
Aug 27 03:45:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Attempting to detach device vdb from instance 970ca110-30d7-4e41-92d3-aa4e0bda4482 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:45:38 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:45:38 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:45:38 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:45:38 user nova-compute[72990]:   <serial>d4903dc3-968e-4c23-8ea2-a6f69be45ad1</serial>
Aug 27 03:45:38 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:45:38 user nova-compute[72990]: </disk>
Aug 27 03:45:38 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:45:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully detached device vdb from instance 970ca110-30d7-4e41-92d3-aa4e0bda4482 from the persistent domain config.
Aug 27 03:45:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 970ca110-30d7-4e41-92d3-aa4e0bda4482 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:45:38 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:45:38 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:45:38 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:45:38 user nova-compute[72990]:   <serial>d4903dc3-968e-4c23-8ea2-a6f69be45ad1</serial>
Aug 27 03:45:38 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:45:38 user nova-compute[72990]: </disk>
Aug 27 03:45:38 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693107938.587484, 970ca110-30d7-4e41-92d3-aa4e0bda4482 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 970ca110-30d7-4e41-92d3-aa4e0bda4482 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:45:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully detached device vdb from instance 970ca110-30d7-4e41-92d3-aa4e0bda4482 from the live domain config.
Aug 27 03:45:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXLyDgGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:45:38 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.045s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[650bb013-1907-4573-9253-be61889a829b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c7d98f-510c-4732-af2b-cea90f858251]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:45:38 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:45:38 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:45:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:45:38 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:45:38 user nova-compute[72990]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 (non-flash)
Aug 27 03:45:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa714390670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc19b4e-fdcd-4bb2-82d7-a849061f5cdc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bc31fd-e1a5-4c1a-822b-9083d4af8125]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7365033-16ac-42ec-9ea3-b71514f5a9d7]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b92779-c8df-4a65-bdae-0ca124403243]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a530ff-b68f-4d27-beff-d5b03be87d04]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd618f6-4968-4679-9625-c16657bf597f]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1, portal: 172.16.0.220,3260]
Aug 27 03:45:38 user nova-compute[72990]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1, portal: 172.16.0.220,3260] successful.
Aug 27 03:45:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4903dc3-968e-4c23-8ea2-a6f69be45ad1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7bdae8-a5d9-45a9-96e1-431210f495d6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] <== disconnect_volume: return (302ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:45:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:45:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:39 user nova-compute[72990]: DEBUG nova.objects.instance [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'flavor' on Instance uuid 970ca110-30d7-4e41-92d3-aa4e0bda4482 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3f6b6f6c-ae15-4043-9d39-86915ba0d95b tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.658s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:45:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:45:46 user nova-compute[72990]: INFO nova.compute.claims [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Claim successful on node user
Aug 27 03:45:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:45:47 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:45:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG nova.policy [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15d5e522dfdc4522a62502bc5ec9133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9f07b56b414b1aaf819802e3ac4b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:45:47 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Creating image(s)
Aug 27 03:45:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "/opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "/opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.205s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk 1073741824" returned: 0 in 0.055s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Successfully created port: 1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Cannot resize image /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Ensure instance console log exists: /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:49 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Successfully updated port: 1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:45:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "refresh_cache-f8dc092c-cd9d-417c-9c70-b805d59b6116" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:45:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquired lock "refresh_cache-f8dc092c-cd9d-417c-9c70-b805d59b6116" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:45:49 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:45:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-322e97f0-7659-4307-8d7f-37a135e6fc6b req-a8e8f4e9-65bd-4ca6-84e4-d8f9a2aa995a service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Received event network-changed-1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-322e97f0-7659-4307-8d7f-37a135e6fc6b req-a8e8f4e9-65bd-4ca6-84e4-d8f9a2aa995a service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Refreshing instance network info cache due to event network-changed-1e76d6dd-c588-401f-9a92-9e0eb13dd67f. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:45:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-322e97f0-7659-4307-8d7f-37a135e6fc6b req-a8e8f4e9-65bd-4ca6-84e4-d8f9a2aa995a service nova] Acquiring lock "refresh_cache-f8dc092c-cd9d-417c-9c70-b805d59b6116" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:45:49 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Updating instance_info_cache with network_info: [{"id": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "address": "fa:16:3e:9b:2a:d8", "network": {"id": "97d760ce-ff1d-43e2-8854-9b0e9e55af5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1248261596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9f07b56b414b1aaf819802e3ac4b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76d6dd-c5", "ovs_interfaceid": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Releasing lock "refresh_cache-f8dc092c-cd9d-417c-9c70-b805d59b6116" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Instance network_info: |[{"id": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "address": "fa:16:3e:9b:2a:d8", "network": {"id": "97d760ce-ff1d-43e2-8854-9b0e9e55af5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1248261596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9f07b56b414b1aaf819802e3ac4b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76d6dd-c5", "ovs_interfaceid": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-322e97f0-7659-4307-8d7f-37a135e6fc6b req-a8e8f4e9-65bd-4ca6-84e4-d8f9a2aa995a service nova] Acquired lock "refresh_cache-f8dc092c-cd9d-417c-9c70-b805d59b6116" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.network.neutron [req-322e97f0-7659-4307-8d7f-37a135e6fc6b req-a8e8f4e9-65bd-4ca6-84e4-d8f9a2aa995a service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Refreshing network info cache for port 1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Start _get_guest_xml network_info=[{"id": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "address": "fa:16:3e:9b:2a:d8", "network": {"id": "97d760ce-ff1d-43e2-8854-9b0e9e55af5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1248261596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9f07b56b414b1aaf819802e3ac4b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76d6dd-c5", "ovs_interfaceid": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:45:50 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:45:50 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1039141753',display_name='tempest-DeleteServersTestJSON-server-1039141753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1039141753',id=17,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df9f07b56b414b1aaf819802e3ac4b35',ramdisk_id='',reservation_id='r-jral4024',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1847790794',owner_user_name='tempest-DeleteServersTestJSON-1847790794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:45:48Z,user_data=None,user_id='15d5e522dfdc4522a62502bc5ec9133f',uuid=f8dc092c-cd9d-417c-9c70-b805d59b6116,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "address": "fa:16:3e:9b:2a:d8", "network": {"id": "97d760ce-ff1d-43e2-8854-9b0e9e55af5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1248261596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9f07b56b414b1aaf819802e3ac4b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76d6dd-c5", "ovs_interfaceid": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Converting VIF {"id": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "address": "fa:16:3e:9b:2a:d8", "network": {"id": "97d760ce-ff1d-43e2-8854-9b0e9e55af5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1248261596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9f07b56b414b1aaf819802e3ac4b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76d6dd-c5", "ovs_interfaceid": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:d8,bridge_name='br-int',has_traffic_filtering=True,id=1e76d6dd-c588-401f-9a92-9e0eb13dd67f,network=Network(97d760ce-ff1d-43e2-8854-9b0e9e55af5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e76d6dd-c5') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.objects.instance [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lazy-loading 'pci_devices' on Instance uuid f8dc092c-cd9d-417c-9c70-b805d59b6116 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:45:50 user nova-compute[72990]:   <uuid>f8dc092c-cd9d-417c-9c70-b805d59b6116</uuid>
Aug 27 03:45:50 user nova-compute[72990]:   <name>instance-00000011</name>
Aug 27 03:45:50 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:45:50 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:45:50 user nova-compute[72990]:   <metadata>
Aug 27 03:45:50 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:45:50 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:45:50 user nova-compute[72990]:       <nova:name>tempest-DeleteServersTestJSON-server-1039141753</nova:name>
Aug 27 03:45:50 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:45:50</nova:creationTime>
Aug 27 03:45:50 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:45:50 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:45:50 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:45:50 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:45:50 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:45:50 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:45:50 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:45:50 user nova-compute[72990]:       <nova:owner>
Aug 27 03:45:50 user nova-compute[72990]:         <nova:user uuid="15d5e522dfdc4522a62502bc5ec9133f">tempest-DeleteServersTestJSON-1847790794-project-member</nova:user>
Aug 27 03:45:50 user nova-compute[72990]:         <nova:project uuid="df9f07b56b414b1aaf819802e3ac4b35">tempest-DeleteServersTestJSON-1847790794</nova:project>
Aug 27 03:45:50 user nova-compute[72990]:       </nova:owner>
Aug 27 03:45:50 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:45:50 user nova-compute[72990]:       <nova:ports>
Aug 27 03:45:50 user nova-compute[72990]:         <nova:port uuid="1e76d6dd-c588-401f-9a92-9e0eb13dd67f">
Aug 27 03:45:50 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 03:45:50 user nova-compute[72990]:         </nova:port>
Aug 27 03:45:50 user nova-compute[72990]:       </nova:ports>
Aug 27 03:45:50 user nova-compute[72990]:     </nova:instance>
Aug 27 03:45:50 user nova-compute[72990]:   </metadata>
Aug 27 03:45:50 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:45:50 user nova-compute[72990]:     <system>
Aug 27 03:45:50 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:45:50 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:45:50 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:45:50 user nova-compute[72990]:       <entry name="serial">f8dc092c-cd9d-417c-9c70-b805d59b6116</entry>
Aug 27 03:45:50 user nova-compute[72990]:       <entry name="uuid">f8dc092c-cd9d-417c-9c70-b805d59b6116</entry>
Aug 27 03:45:50 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:45:50 user nova-compute[72990]:     </system>
Aug 27 03:45:50 user nova-compute[72990]:   </sysinfo>
Aug 27 03:45:50 user nova-compute[72990]:   <os>
Aug 27 03:45:50 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:45:50 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:45:50 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:45:50 user nova-compute[72990]:   </os>
Aug 27 03:45:50 user nova-compute[72990]:   <features>
Aug 27 03:45:50 user nova-compute[72990]:     <acpi/>
Aug 27 03:45:50 user nova-compute[72990]:     <apic/>
Aug 27 03:45:50 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:45:50 user nova-compute[72990]:   </features>
Aug 27 03:45:50 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:45:50 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:45:50 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:45:50 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:45:50 user nova-compute[72990]:   </clock>
Aug 27 03:45:50 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:45:50 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:45:50 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:45:50 user nova-compute[72990]:   </cpu>
Aug 27 03:45:50 user nova-compute[72990]:   <devices>
Aug 27 03:45:50 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:45:50 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:45:50 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk"/>
Aug 27 03:45:50 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:45:50 user nova-compute[72990]:     </disk>
Aug 27 03:45:50 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:45:50 user nova-compute[72990]:       <mac address="fa:16:3e:9b:2a:d8"/>
Aug 27 03:45:50 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:45:50 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:45:50 user nova-compute[72990]:       <target dev="tap1e76d6dd-c5"/>
Aug 27 03:45:50 user nova-compute[72990]:     </interface>
Aug 27 03:45:50 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:45:50 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/console.log" append="off"/>
Aug 27 03:45:50 user nova-compute[72990]:     </serial>
Aug 27 03:45:50 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:45:50 user nova-compute[72990]:     <video>
Aug 27 03:45:50 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:45:50 user nova-compute[72990]:     </video>
Aug 27 03:45:50 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:45:50 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:45:50 user nova-compute[72990]:     </rng>
Aug 27 03:45:50 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:45:50 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:45:50 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:45:50 user nova-compute[72990]:     </memballoon>
Aug 27 03:45:50 user nova-compute[72990]:   </devices>
Aug 27 03:45:50 user nova-compute[72990]: </domain>
Aug 27 03:45:50 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1039141753',display_name='tempest-DeleteServersTestJSON-server-1039141753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1039141753',id=17,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df9f07b56b414b1aaf819802e3ac4b35',ramdisk_id='',reservation_id='r-jral4024',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1847790794',owner_user_name='tempest-DeleteServersTestJSON-1847790794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:45:48Z,user_data=None,user_id='15d5e522dfdc4522a62502bc5ec9133f',uuid=f8dc092c-cd9d-417c-9c70-b805d59b6116,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "address": "fa:16:3e:9b:2a:d8", "network": {"id": "97d760ce-ff1d-43e2-8854-9b0e9e55af5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1248261596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9f07b56b414b1aaf819802e3ac4b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76d6dd-c5", "ovs_interfaceid": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Converting VIF {"id": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "address": "fa:16:3e:9b:2a:d8", "network": {"id": "97d760ce-ff1d-43e2-8854-9b0e9e55af5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1248261596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9f07b56b414b1aaf819802e3ac4b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76d6dd-c5", "ovs_interfaceid": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:d8,bridge_name='br-int',has_traffic_filtering=True,id=1e76d6dd-c588-401f-9a92-9e0eb13dd67f,network=Network(97d760ce-ff1d-43e2-8854-9b0e9e55af5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e76d6dd-c5') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG os_vif [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:d8,bridge_name='br-int',has_traffic_filtering=True,id=1e76d6dd-c588-401f-9a92-9e0eb13dd67f,network=Network(97d760ce-ff1d-43e2-8854-9b0e9e55af5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e76d6dd-c5') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e76d6dd-c5, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e76d6dd-c5, col_values=(('external_ids', {'iface-id': '1e76d6dd-c588-401f-9a92-9e0eb13dd67f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:2a:d8', 'vm-uuid': 'f8dc092c-cd9d-417c-9c70-b805d59b6116'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:50 user nova-compute[72990]: INFO os_vif [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:d8,bridge_name='br-int',has_traffic_filtering=True,id=1e76d6dd-c588-401f-9a92-9e0eb13dd67f,network=Network(97d760ce-ff1d-43e2-8854-9b0e9e55af5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e76d6dd-c5')
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] No VIF found with MAC fa:16:3e:9b:2a:d8, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.network.neutron [req-322e97f0-7659-4307-8d7f-37a135e6fc6b req-a8e8f4e9-65bd-4ca6-84e4-d8f9a2aa995a service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Updated VIF entry in instance network info cache for port 1e76d6dd-c588-401f-9a92-9e0eb13dd67f. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG nova.network.neutron [req-322e97f0-7659-4307-8d7f-37a135e6fc6b req-a8e8f4e9-65bd-4ca6-84e4-d8f9a2aa995a service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Updating instance_info_cache with network_info: [{"id": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "address": "fa:16:3e:9b:2a:d8", "network": {"id": "97d760ce-ff1d-43e2-8854-9b0e9e55af5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1248261596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9f07b56b414b1aaf819802e3ac4b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76d6dd-c5", "ovs_interfaceid": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:45:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-322e97f0-7659-4307-8d7f-37a135e6fc6b req-a8e8f4e9-65bd-4ca6-84e4-d8f9a2aa995a service nova] Releasing lock "refresh_cache-f8dc092c-cd9d-417c-9c70-b805d59b6116" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:45:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:52 user nova-compute[72990]: DEBUG nova.compute.manager [req-f7b60558-5b4d-4a2a-9b99-05e39efa18f1 req-c32c1a1f-9fb9-450d-b3ab-e07cda5b15a3 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Received event network-vif-plugged-1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f7b60558-5b4d-4a2a-9b99-05e39efa18f1 req-c32c1a1f-9fb9-450d-b3ab-e07cda5b15a3 service nova] Acquiring lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f7b60558-5b4d-4a2a-9b99-05e39efa18f1 req-c32c1a1f-9fb9-450d-b3ab-e07cda5b15a3 service nova] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f7b60558-5b4d-4a2a-9b99-05e39efa18f1 req-c32c1a1f-9fb9-450d-b3ab-e07cda5b15a3 service nova] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:52 user nova-compute[72990]: DEBUG nova.compute.manager [req-f7b60558-5b4d-4a2a-9b99-05e39efa18f1 req-c32c1a1f-9fb9-450d-b3ab-e07cda5b15a3 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] No waiting events found dispatching network-vif-plugged-1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:52 user nova-compute[72990]: WARNING nova.compute.manager [req-f7b60558-5b4d-4a2a-9b99-05e39efa18f1 req-c32c1a1f-9fb9-450d-b3ab-e07cda5b15a3 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Received unexpected event network-vif-plugged-1e76d6dd-c588-401f-9a92-9e0eb13dd67f for instance with vm_state building and task_state spawning.
Aug 27 03:45:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107954.0116746, f8dc092c-cd9d-417c-9c70-b805d59b6116 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:45:54 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] VM Resumed (Lifecycle Event)
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:45:54 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Instance spawned successfully.
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:45:54 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107954.0133038, f8dc092c-cd9d-417c-9c70-b805d59b6116 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:45:54 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] VM Started (Lifecycle Event)
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-1839e727-56a4-4250-8585-f22e3dbf26e6 req-5c3afebd-f861-4e4f-aca2-6dc6b91b6722 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Received event network-vif-plugged-1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1839e727-56a4-4250-8585-f22e3dbf26e6 req-5c3afebd-f861-4e4f-aca2-6dc6b91b6722 service nova] Acquiring lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1839e727-56a4-4250-8585-f22e3dbf26e6 req-5c3afebd-f861-4e4f-aca2-6dc6b91b6722 service nova] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1839e727-56a4-4250-8585-f22e3dbf26e6 req-5c3afebd-f861-4e4f-aca2-6dc6b91b6722 service nova] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-1839e727-56a4-4250-8585-f22e3dbf26e6 req-5c3afebd-f861-4e4f-aca2-6dc6b91b6722 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] No waiting events found dispatching network-vif-plugged-1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:45:54 user nova-compute[72990]: WARNING nova.compute.manager [req-1839e727-56a4-4250-8585-f22e3dbf26e6 req-5c3afebd-f861-4e4f-aca2-6dc6b91b6722 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Received unexpected event network-vif-plugged-1e76d6dd-c588-401f-9a92-9e0eb13dd67f for instance with vm_state building and task_state spawning.
Aug 27 03:45:54 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:45:54 user nova-compute[72990]: INFO nova.compute.manager [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Took 6.50 seconds to spawn the instance on the hypervisor.
Aug 27 03:45:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:45:54 user nova-compute[72990]: INFO nova.compute.manager [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Took 7.37 seconds to build instance.
Aug 27 03:45:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d14d8ca2-150c-4961-af08-ffffaf9b6e90 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.474s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:45:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:45:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:00 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:14 user nova-compute[72990]: INFO nova.compute.manager [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Terminating instance
Aug 27 03:46:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Instance destroyed successfully.
Aug 27 03:46:14 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lazy-loading 'resources' on Instance uuid fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:44:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1243667798',display_name='tempest-VolumesAdminNegativeTest-server-1243667798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1243667798',id=14,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:44:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c8ee9d65a3449cc8793fe94beb962b9',ramdisk_id='',reservation_id='r-w759omxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1331051968',owner_user_name='tempest-VolumesAdminNegativeTest-1331051968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:44:14Z,user_data=None,user_id='70e76f4237f8491da1a1003787625936',uuid=fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "address": "fa:16:3e:11:17:25", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c472fe-26", "ovs_interfaceid": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Converting VIF {"id": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "address": "fa:16:3e:11:17:25", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c472fe-26", "ovs_interfaceid": "b4c472fe-263f-4cbf-8f0a-67b47d6509fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:25,bridge_name='br-int',has_traffic_filtering=True,id=b4c472fe-263f-4cbf-8f0a-67b47d6509fb,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c472fe-26') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG os_vif [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:25,bridge_name='br-int',has_traffic_filtering=True,id=b4c472fe-263f-4cbf-8f0a-67b47d6509fb,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c472fe-26') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4c472fe-26, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:46:14 user nova-compute[72990]: INFO os_vif [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:25,bridge_name='br-int',has_traffic_filtering=True,id=b4c472fe-263f-4cbf-8f0a-67b47d6509fb,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c472fe-26')
Aug 27 03:46:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Deleting instance files /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31_del
Aug 27 03:46:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Deletion of /opt/stack/data/nova/instances/fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31_del complete
Aug 27 03:46:14 user nova-compute[72990]: INFO nova.compute.manager [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 27 03:46:14 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-d291aa2a-42fd-41dc-8833-0734363bcf83 req-56b745d9-760e-473f-ad1c-0618f69c6e66 service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Received event network-vif-unplugged-b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d291aa2a-42fd-41dc-8833-0734363bcf83 req-56b745d9-760e-473f-ad1c-0618f69c6e66 service nova] Acquiring lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d291aa2a-42fd-41dc-8833-0734363bcf83 req-56b745d9-760e-473f-ad1c-0618f69c6e66 service nova] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d291aa2a-42fd-41dc-8833-0734363bcf83 req-56b745d9-760e-473f-ad1c-0618f69c6e66 service nova] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-d291aa2a-42fd-41dc-8833-0734363bcf83 req-56b745d9-760e-473f-ad1c-0618f69c6e66 service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] No waiting events found dispatching network-vif-unplugged-b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-d291aa2a-42fd-41dc-8833-0734363bcf83 req-56b745d9-760e-473f-ad1c-0618f69c6e66 service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Received event network-vif-unplugged-b4c472fe-263f-4cbf-8f0a-67b47d6509fb for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:46:15 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:46:15 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Took 0.69 seconds to deallocate network for instance.
Aug 27 03:46:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-e0c25f3f-38c7-45ec-8e09-45666e895c34 req-ca7d5a81-e3ca-4081-ac0a-1729ddf8a8ca service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Received event network-vif-deleted-b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:15 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:46:15 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:46:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:16 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Deleted allocations for instance fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31
Aug 27 03:46:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f3f878b9-cbe4-4935-9818-1017efe566fe tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.150s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-8921ed25-1d4a-4fbb-9b82-7a9b612a8595 req-adbd47d0-5c4f-4135-ab91-9287027217f2 service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Received event network-vif-plugged-b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8921ed25-1d4a-4fbb-9b82-7a9b612a8595 req-adbd47d0-5c4f-4135-ab91-9287027217f2 service nova] Acquiring lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8921ed25-1d4a-4fbb-9b82-7a9b612a8595 req-adbd47d0-5c4f-4135-ab91-9287027217f2 service nova] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8921ed25-1d4a-4fbb-9b82-7a9b612a8595 req-adbd47d0-5c4f-4135-ab91-9287027217f2 service nova] Lock "fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-8921ed25-1d4a-4fbb-9b82-7a9b612a8595 req-adbd47d0-5c4f-4135-ab91-9287027217f2 service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] No waiting events found dispatching network-vif-plugged-b4c472fe-263f-4cbf-8f0a-67b47d6509fb {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:17 user nova-compute[72990]: WARNING nova.compute.manager [req-8921ed25-1d4a-4fbb-9b82-7a9b612a8595 req-adbd47d0-5c4f-4135-ab91-9287027217f2 service nova] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Received unexpected event network-vif-plugged-b4c472fe-263f-4cbf-8f0a-67b47d6509fb for instance with vm_state deleted and task_state None.
Aug 27 03:46:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:17 user nova-compute[72990]: DEBUG nova.objects.instance [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lazy-loading 'flavor' on Instance uuid ed1742b9-a19d-43f9-b39a-7257261f858c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:46:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:18 user nova-compute[72990]: INFO nova.compute.manager [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Attaching volume 0932a7f4-a646-4455-a1e4-ec89ce3c1deb to /dev/vdb
Aug 27 03:46:18 user nova-compute[72990]: DEBUG os_brick.utils [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5737af74-e332-4fbc-9860-b392df0822f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4749b333-2cd3-44df-b5db-f570ff95728d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b655edff-70e8-4880-9f90-9259e7f62ffd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5610aa-5152-4c49-b59f-2d98bb6c8990]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:46:18 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8306c508-da5e-4f66-a6d4-4f42b7f0d527]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG os_brick.utils [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Updating existing volume attachment record: f0801849-38ae-41d6-b8b5-4c95e13a8533 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:18 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:19 user nova-compute[72990]: DEBUG nova.compute.manager [req-aed23e83-8773-4f13-bcca-80135040fc82 req-a062ae17-5842-41e6-ae43-e02f9bc1b529 service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received event network-changed-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:19 user nova-compute[72990]: DEBUG nova.compute.manager [req-aed23e83-8773-4f13-bcca-80135040fc82 req-a062ae17-5842-41e6-ae43-e02f9bc1b529 service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Refreshing instance network info cache due to event network-changed-9e575e22-6f02-488a-8e18-e9675c3b96ab. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:46:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aed23e83-8773-4f13-bcca-80135040fc82 req-a062ae17-5842-41e6-ae43-e02f9bc1b529 service nova] Acquiring lock "refresh_cache-ed1742b9-a19d-43f9-b39a-7257261f858c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:46:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aed23e83-8773-4f13-bcca-80135040fc82 req-a062ae17-5842-41e6-ae43-e02f9bc1b529 service nova] Acquired lock "refresh_cache-ed1742b9-a19d-43f9-b39a-7257261f858c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:46:19 user nova-compute[72990]: DEBUG nova.network.neutron [req-aed23e83-8773-4f13-bcca-80135040fc82 req-a062ae17-5842-41e6-ae43-e02f9bc1b529 service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Refreshing network info cache for port 9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:46:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:20 user nova-compute[72990]: DEBUG nova.network.neutron [req-aed23e83-8773-4f13-bcca-80135040fc82 req-a062ae17-5842-41e6-ae43-e02f9bc1b529 service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Updated VIF entry in instance network info cache for port 9e575e22-6f02-488a-8e18-e9675c3b96ab. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:46:20 user nova-compute[72990]: DEBUG nova.network.neutron [req-aed23e83-8773-4f13-bcca-80135040fc82 req-a062ae17-5842-41e6-ae43-e02f9bc1b529 service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Updating instance_info_cache with network_info: [{"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:46:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aed23e83-8773-4f13-bcca-80135040fc82 req-a062ae17-5842-41e6-ae43-e02f9bc1b529 service nova] Releasing lock "refresh_cache-ed1742b9-a19d-43f9-b39a-7257261f858c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:46:21 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:21 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:46:21 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 03:46:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] There are 0 instances to clean {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 03:46:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:22 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:22 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:23 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:23 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:46:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:46:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:46:25 user nova-compute[72990]: INFO nova.compute.claims [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Claim successful on node user
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Refreshing inventories for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Updating ProviderTree inventory for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Updating inventory in ProviderTree for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 03:46:25 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Refreshing aggregate associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, aggregates: None {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Refreshing trait associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.815s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:46:26 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:46:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG nova.policy [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f71b8c6ad2624149b3760b97ab8a9e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa88907cc54e01abeabdfb040a6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:46:26 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Creating image(s)
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "/opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "/opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "/opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.198s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk 1073741824" returned: 0 in 0.053s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Successfully created port: 09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Checking if we can resize image /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Cannot resize image /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Ensure instance console log exists: /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Successfully updated port: 09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-bbb8fd8c-afa6-47bb-9de0-c4575ce977ca req-aebb974c-a799-47aa-b348-59dc4d015745 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-changed-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-bbb8fd8c-afa6-47bb-9de0-c4575ce977ca req-aebb974c-a799-47aa-b348-59dc4d015745 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Refreshing instance network info cache due to event network-changed-09f159e5-8c35-4fa2-a2e9-873634e6a084. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bbb8fd8c-afa6-47bb-9de0-c4575ce977ca req-aebb974c-a799-47aa-b348-59dc4d015745 service nova] Acquiring lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bbb8fd8c-afa6-47bb-9de0-c4575ce977ca req-aebb974c-a799-47aa-b348-59dc4d015745 service nova] Acquired lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG nova.network.neutron [req-bbb8fd8c-afa6-47bb-9de0-c4575ce977ca req-aebb974c-a799-47aa-b348-59dc4d015745 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Refreshing network info cache for port 09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:28 user nova-compute[72990]: INFO nova.compute.manager [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Terminating instance
Aug 27 03:46:28 user nova-compute[72990]: DEBUG nova.compute.manager [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG nova.network.neutron [req-bbb8fd8c-afa6-47bb-9de0-c4575ce977ca req-aebb974c-a799-47aa-b348-59dc4d015745 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.rescue --force-share --output=json" returned: 0 in 0.272s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:28 user nova-compute[72990]: DEBUG nova.network.neutron [req-bbb8fd8c-afa6-47bb-9de0-c4575ce977ca req-aebb974c-a799-47aa-b348-59dc4d015745 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bbb8fd8c-afa6-47bb-9de0-c4575ce977ca req-aebb974c-a799-47aa-b348-59dc4d015745 service nova] Releasing lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquired lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:29 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Instance destroyed successfully.
Aug 27 03:46:29 user nova-compute[72990]: DEBUG nova.objects.instance [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'resources' on Instance uuid 970ca110-30d7-4e41-92d3-aa4e0bda4482 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-141058830',display_name='tempest-AttachVolumeNegativeTest-server-141058830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-141058830',id=6,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWORsaUu8hyR5t7tsTpUJcT9qwLvuCugt4ZtUfdJHrt2j+YFS1ySrkgr8nPSviJ6GzMZ9yMLnC3txJGfFhDiPCM4BKcalbJ3vNSbuhNjhtJpp8ltdQ0HDxzLofc7jqSAQ==',key_name='tempest-keypair-1480652458',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d007a65dbbce40729d2d7a25561a4f91',ramdisk_id='',reservation_id='r-euaan0ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-945598863',owner_user_name='tempest-AttachVolumeNegativeTest-945598863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7d2fc4d4204ad38d0d11376de45bd6',uuid=970ca110-30d7-4e41-92d3-aa4e0bda4482,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "address": "fa:16:3e:2f:ee:bb", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6b8fd-99", "ovs_interfaceid": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converting VIF {"id": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "address": "fa:16:3e:2f:ee:bb", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6b8fd-99", "ovs_interfaceid": "11a6b8fd-99ad-43d8-9daa-4594047d1ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:ee:bb,bridge_name='br-int',has_traffic_filtering=True,id=11a6b8fd-99ad-43d8-9daa-4594047d1ee8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6b8fd-99') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG os_vif [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:ee:bb,bridge_name='br-int',has_traffic_filtering=True,id=11a6b8fd-99ad-43d8-9daa-4594047d1ee8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6b8fd-99') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11a6b8fd-99, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:46:29 user nova-compute[72990]: INFO os_vif [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:ee:bb,bridge_name='br-int',has_traffic_filtering=True,id=11a6b8fd-99ad-43d8-9daa-4594047d1ee8,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6b8fd-99')
Aug 27 03:46:29 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Deleting instance files /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482_del
Aug 27 03:46:29 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Deletion of /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482_del complete
Aug 27 03:46:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json" returned: 1 in 0.236s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk --force-share --output=json' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:46:29 user nova-compute[72990]: INFO nova.compute.manager [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 27 03:46:29 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:46:29 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000006, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/970ca110-30d7-4e41-92d3-aa4e0bda4482/disk
Aug 27 03:46:29 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:46:29 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693107974.5963302, fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:46:29 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] VM Stopped (Lifecycle Event)
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating instance_info_cache with network_info: [{"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-128841fc-348e-4a95-bcfe-b1c3a8a7d817 None None] [instance: fefa7b9f-79c4-4c4f-8d12-f33aeb86bf31] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-8dabec18-91b0-4cfc-904a-2e2b24429d75 req-f24c7579-14d6-4103-a18e-7cd0f93813fd service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-changed-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-8dabec18-91b0-4cfc-904a-2e2b24429d75 req-f24c7579-14d6-4103-a18e-7cd0f93813fd service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Refreshing instance network info cache due to event network-changed-f875fdb9-c314-4ded-9793-cb49e10bbdd8. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8dabec18-91b0-4cfc-904a-2e2b24429d75 req-f24c7579-14d6-4103-a18e-7cd0f93813fd service nova] Acquiring lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8dabec18-91b0-4cfc-904a-2e2b24429d75 req-f24c7579-14d6-4103-a18e-7cd0f93813fd service nova] Acquired lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.network.neutron [req-8dabec18-91b0-4cfc-904a-2e2b24429d75 req-f24c7579-14d6-4103-a18e-7cd0f93813fd service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Refreshing network info cache for port f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Releasing lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance network_info: |[{"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Start _get_guest_xml network_info=[{"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:46:30 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:46:30 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7129MB free_disk=25.24976348876953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:30 user nova-compute[72990]: INFO nova.compute.manager [None req-4c1d0d8a-e687-430a-a9dc-5fea285737f3 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Unrescuing
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4c1d0d8a-e687-430a-a9dc-5fea285737f3 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4c1d0d8a-e687-430a-a9dc-5fea285737f3 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquired lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.network.neutron [None req-4c1d0d8a-e687-430a-a9dc-5fea285737f3 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:46:30 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:46:30 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2048756041',display_name='tempest-ServerActionsTestOtherB-server-2048756041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2048756041',id=18,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvV5/xdIrrMiR/5VLCxhM3KKboDXXvobrXZoxgpQUAOozywbLJ2xsxdUcEhJo7m/5kpTKUpySOn2yAwFLCYDLgNxiCX1IdtXhqxCfcecMFLg6qxM0T/ZTj+kDi4FnruVQ==',key_name='tempest-keypair-1100770948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3efa88907cc54e01abeabdfb040a6d23',ramdisk_id='',reservation_id='r-v5k469oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-862895181',owner_user_name='tempest-ServerActionsTestOtherB-862895181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f71b8c6ad2624149b3760b97ab8a9e4a',uuid=338682cb-8c70-49c3-b88c-362e96ec8fb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converting VIF {"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.objects.instance [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lazy-loading 'pci_devices' on Instance uuid 338682cb-8c70-49c3-b88c-362e96ec8fb1 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:46:30 user nova-compute[72990]:   <uuid>338682cb-8c70-49c3-b88c-362e96ec8fb1</uuid>
Aug 27 03:46:30 user nova-compute[72990]:   <name>instance-00000012</name>
Aug 27 03:46:30 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:46:30 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:46:30 user nova-compute[72990]:   <metadata>
Aug 27 03:46:30 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:46:30 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:46:30 user nova-compute[72990]:       <nova:name>tempest-ServerActionsTestOtherB-server-2048756041</nova:name>
Aug 27 03:46:30 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:46:30</nova:creationTime>
Aug 27 03:46:30 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:46:30 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:46:30 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:46:30 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:46:30 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:46:30 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:46:30 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:46:30 user nova-compute[72990]:       <nova:owner>
Aug 27 03:46:30 user nova-compute[72990]:         <nova:user uuid="f71b8c6ad2624149b3760b97ab8a9e4a">tempest-ServerActionsTestOtherB-862895181-project-member</nova:user>
Aug 27 03:46:30 user nova-compute[72990]:         <nova:project uuid="3efa88907cc54e01abeabdfb040a6d23">tempest-ServerActionsTestOtherB-862895181</nova:project>
Aug 27 03:46:30 user nova-compute[72990]:       </nova:owner>
Aug 27 03:46:30 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:46:30 user nova-compute[72990]:       <nova:ports>
Aug 27 03:46:30 user nova-compute[72990]:         <nova:port uuid="09f159e5-8c35-4fa2-a2e9-873634e6a084">
Aug 27 03:46:30 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 03:46:30 user nova-compute[72990]:         </nova:port>
Aug 27 03:46:30 user nova-compute[72990]:       </nova:ports>
Aug 27 03:46:30 user nova-compute[72990]:     </nova:instance>
Aug 27 03:46:30 user nova-compute[72990]:   </metadata>
Aug 27 03:46:30 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:46:30 user nova-compute[72990]:     <system>
Aug 27 03:46:30 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:46:30 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:46:30 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:46:30 user nova-compute[72990]:       <entry name="serial">338682cb-8c70-49c3-b88c-362e96ec8fb1</entry>
Aug 27 03:46:30 user nova-compute[72990]:       <entry name="uuid">338682cb-8c70-49c3-b88c-362e96ec8fb1</entry>
Aug 27 03:46:30 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:46:30 user nova-compute[72990]:     </system>
Aug 27 03:46:30 user nova-compute[72990]:   </sysinfo>
Aug 27 03:46:30 user nova-compute[72990]:   <os>
Aug 27 03:46:30 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:46:30 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:46:30 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:46:30 user nova-compute[72990]:   </os>
Aug 27 03:46:30 user nova-compute[72990]:   <features>
Aug 27 03:46:30 user nova-compute[72990]:     <acpi/>
Aug 27 03:46:30 user nova-compute[72990]:     <apic/>
Aug 27 03:46:30 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:46:30 user nova-compute[72990]:   </features>
Aug 27 03:46:30 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:46:30 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:46:30 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:46:30 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:46:30 user nova-compute[72990]:   </clock>
Aug 27 03:46:30 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:46:30 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:46:30 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:46:30 user nova-compute[72990]:   </cpu>
Aug 27 03:46:30 user nova-compute[72990]:   <devices>
Aug 27 03:46:30 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:46:30 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:46:30 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk"/>
Aug 27 03:46:30 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:46:30 user nova-compute[72990]:     </disk>
Aug 27 03:46:30 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:46:30 user nova-compute[72990]:       <mac address="fa:16:3e:94:53:13"/>
Aug 27 03:46:30 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:46:30 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:46:30 user nova-compute[72990]:       <target dev="tap09f159e5-8c"/>
Aug 27 03:46:30 user nova-compute[72990]:     </interface>
Aug 27 03:46:30 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:46:30 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/console.log" append="off"/>
Aug 27 03:46:30 user nova-compute[72990]:     </serial>
Aug 27 03:46:30 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:46:30 user nova-compute[72990]:     <video>
Aug 27 03:46:30 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:46:30 user nova-compute[72990]:     </video>
Aug 27 03:46:30 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:46:30 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:46:30 user nova-compute[72990]:     </rng>
Aug 27 03:46:30 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:46:30 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:46:30 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:46:30 user nova-compute[72990]:     </memballoon>
Aug 27 03:46:30 user nova-compute[72990]:   </devices>
Aug 27 03:46:30 user nova-compute[72990]: </domain>
Aug 27 03:46:30 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2048756041',display_name='tempest-ServerActionsTestOtherB-server-2048756041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2048756041',id=18,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvV5/xdIrrMiR/5VLCxhM3KKboDXXvobrXZoxgpQUAOozywbLJ2xsxdUcEhJo7m/5kpTKUpySOn2yAwFLCYDLgNxiCX1IdtXhqxCfcecMFLg6qxM0T/ZTj+kDi4FnruVQ==',key_name='tempest-keypair-1100770948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3efa88907cc54e01abeabdfb040a6d23',ramdisk_id='',reservation_id='r-v5k469oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-862895181',owner_user_name='tempest-ServerActionsTestOtherB-862895181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f71b8c6ad2624149b3760b97ab8a9e4a',uuid=338682cb-8c70-49c3-b88c-362e96ec8fb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converting VIF {"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG os_vif [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09f159e5-8c, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09f159e5-8c, col_values=(('external_ids', {'iface-id': '09f159e5-8c35-4fa2-a2e9-873634e6a084', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:53:13', 'vm-uuid': '338682cb-8c70-49c3-b88c-362e96ec8fb1'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:30 user nova-compute[72990]: INFO os_vif [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c')
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] No VIF found with MAC fa:16:3e:94:53:13, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-d7f58750-d804-4f05-9229-97296ff8fd58 req-c4123ff3-2c86-499a-a0fb-fa78edecf063 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Received event network-vif-unplugged-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d7f58750-d804-4f05-9229-97296ff8fd58 req-c4123ff3-2c86-499a-a0fb-fa78edecf063 service nova] Acquiring lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d7f58750-d804-4f05-9229-97296ff8fd58 req-c4123ff3-2c86-499a-a0fb-fa78edecf063 service nova] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d7f58750-d804-4f05-9229-97296ff8fd58 req-c4123ff3-2c86-499a-a0fb-fa78edecf063 service nova] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-d7f58750-d804-4f05-9229-97296ff8fd58 req-c4123ff3-2c86-499a-a0fb-fa78edecf063 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] No waiting events found dispatching network-vif-unplugged-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-d7f58750-d804-4f05-9229-97296ff8fd58 req-c4123ff3-2c86-499a-a0fb-fa78edecf063 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Received event network-vif-unplugged-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-d7f58750-d804-4f05-9229-97296ff8fd58 req-c4123ff3-2c86-499a-a0fb-fa78edecf063 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Received event network-vif-plugged-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d7f58750-d804-4f05-9229-97296ff8fd58 req-c4123ff3-2c86-499a-a0fb-fa78edecf063 service nova] Acquiring lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d7f58750-d804-4f05-9229-97296ff8fd58 req-c4123ff3-2c86-499a-a0fb-fa78edecf063 service nova] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d7f58750-d804-4f05-9229-97296ff8fd58 req-c4123ff3-2c86-499a-a0fb-fa78edecf063 service nova] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-d7f58750-d804-4f05-9229-97296ff8fd58 req-c4123ff3-2c86-499a-a0fb-fa78edecf063 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] No waiting events found dispatching network-vif-plugged-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:30 user nova-compute[72990]: WARNING nova.compute.manager [req-d7f58750-d804-4f05-9229-97296ff8fd58 req-c4123ff3-2c86-499a-a0fb-fa78edecf063 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Received unexpected event network-vif-plugged-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 for instance with vm_state active and task_state deleting.
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 970ca110-30d7-4e41-92d3-aa4e0bda4482 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bc82cced-9f16-44bc-b9bc-622fa99b1be0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ed1742b9-a19d-43f9-b39a-7257261f858c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 1e81de88-259e-4124-8e2c-cafd310a9b42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance f8dc092c-cd9d-417c-9c70-b805d59b6116 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 338682cb-8c70-49c3-b88c-362e96ec8fb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiNAcEjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:46:30 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:46:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:46:30 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:46:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:46:30 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0c43f1-9c4a-42ee-b740-b6952cdb65ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:46:30 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd75bd2-2805-43ab-afac-95799a42ae62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb] added
Aug 27 03:46:30 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc11905-6054-4bbf-be03-7502481ef196]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9617d83d-4fde-40d6-a598-ac5ed704bf84]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KiNAcEjm {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KiNAcEjm" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f01c45-8b11-4e1a-8019-df7c191d5ec5]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KiNAcEjm'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.830s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[79be9a14-eec5-41dc-82b1-b0b1da70afd9]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72990) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e4c1dd-f57b-45bd-931a-52eb451a67e6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:46:31 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:46:31 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:46:31 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:46:31 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e948df0-44d8-4c81-88e8-31ecc06fba28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260]
Aug 27 03:46:31 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260] successful.
Aug 27 03:46:31 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd4c562-96ac-444a-8472-802af89af639]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ae8f9e-1e50-442f-82cc-57f8dec30983]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:46:31 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:46:31 user nova-compute[72990]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:46:31 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:46:31 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:46:31 user nova-compute[72990]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:46:31 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a60d8-497d-4439-b08c-b8d770acbf52]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-changed-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Refreshing instance network info cache due to event network-changed-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:46:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] Acquiring lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-8dabec18-91b0-4cfc-904a-2e2b24429d75 req-f24c7579-14d6-4103-a18e-7cd0f93813fd service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updated VIF entry in instance network info cache for port f875fdb9-c314-4ded-9793-cb49e10bbdd8. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-8dabec18-91b0-4cfc-904a-2e2b24429d75 req-f24c7579-14d6-4103-a18e-7cd0f93813fd service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updating instance_info_cache with network_info: [{"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Skipping network cache update for instance because it is being deleted. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8dabec18-91b0-4cfc-904a-2e2b24429d75 req-f24c7579-14d6-4103-a18e-7cd0f93813fd service nova] Releasing lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-4c1d0d8a-e687-430a-a9dc-5fea285737f3 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiNAcEjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26663393061666339', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663393061666339', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4c1d0d8a-e687-430a-a9dc-5fea285737f3 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Releasing lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.objects.instance [None req-4c1d0d8a-e687-430a-a9dc-5fea285737f3 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lazy-loading 'flavor' on Instance uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] Acquired lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Refreshing network info cache for port eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.objects.instance [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lazy-loading 'flavor' on Instance uuid ed1742b9-a19d-43f9-b39a-7257261f858c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-bc82cced-9f16-44bc-b9bc-622fa99b1be0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-bc82cced-9f16-44bc-b9bc-622fa99b1be0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:46:32 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:46:32 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:46:32 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:46:32 user nova-compute[72990]:   <serial>0932a7f4-a646-4455-a1e4-ec89ce3c1deb</serial>
Aug 27 03:46:32 user nova-compute[72990]: </disk>
Aug 27 03:46:32 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No VIF found with MAC fa:16:3e:07:eb:d3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:46:32 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Took 3.28 seconds to deallocate network for instance.
Aug 27 03:46:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-46acb38e-9fa7-4064-9787-d2f5620fc62b req-1d7df738-0da7-4f9c-aa0d-b038318eea56 service nova] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Received event network-vif-deleted-11a6b8fd-99ad-43d8-9daa-4594047d1ee8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-49efe7ff-91b1-4d45-b5ae-b63da9632063 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.902s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:33 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Instance destroyed successfully.
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Updating instance_info_cache with network_info: [{"id": "48bea006-1d46-416d-8ab6-99617cdbcb63", "address": "fa:16:3e:b7:4e:53", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bea006-1d", "ovs_interfaceid": "48bea006-1d46-416d-8ab6-99617cdbcb63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updated VIF entry in instance network info cache for port eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-bc82cced-9f16-44bc-b9bc-622fa99b1be0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] Releasing lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-changed-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Refreshing instance network info cache due to event network-changed-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] Acquiring lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] Acquired lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Refreshing network info cache for port eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:33 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Deleted allocations for instance 970ca110-30d7-4e41-92d3-aa4e0bda4482
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-486b9a82-1060-4ffe-9603-17d5c078486f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "970ca110-30d7-4e41-92d3-aa4e0bda4482" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.105s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updated VIF entry in instance network info cache for port eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a55be3d7-3501-4e98-a334-705b49e7d8f9 req-768f7dc3-c126-47a1-9f4a-6660bc1489c5 service nova] Releasing lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:33 user nova-compute[72990]: WARNING nova.compute.manager [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state building and task_state spawning.
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:33 user nova-compute[72990]: WARNING nova.compute.manager [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state building and task_state spawning.
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-unplugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] No waiting events found dispatching network-vif-unplugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:33 user nova-compute[72990]: WARNING nova.compute.manager [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received unexpected event network-vif-unplugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] No waiting events found dispatching network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:33 user nova-compute[72990]: WARNING nova.compute.manager [req-dd8338db-3451-4239-8204-fa21c0f3401a req-35239e41-2f33-45c3-98b8-3fdd8e71d8a1 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received unexpected event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107994.2569067, 338682cb-8c70-49c3-b88c-362e96ec8fb1 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:46:34 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] VM Resumed (Lifecycle Event)
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:46:34 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance spawned successfully.
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:46:34 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107994.2587621, 338682cb-8c70-49c3-b88c-362e96ec8fb1 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:46:34 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] VM Started (Lifecycle Event)
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:46:34 user nova-compute[72990]: INFO nova.compute.manager [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Rebuilding instance
Aug 27 03:46:34 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:46:34 user nova-compute[72990]: INFO nova.compute.manager [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Took 7.54 seconds to spawn the instance on the hypervisor.
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:34 user nova-compute[72990]: INFO nova.compute.manager [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Took 8.95 seconds to build instance.
Aug 27 03:46:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5b48f85a-3006-4a0a-9329-1d6b2a66c73a tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.135s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:35 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Instance destroyed successfully.
Aug 27 03:46:35 user nova-compute[72990]: INFO nova.compute.manager [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Detaching volume 0932a7f4-a646-4455-a1e4-ec89ce3c1deb
Aug 27 03:46:35 user nova-compute[72990]: INFO nova.virt.block_device [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Attempting to driver detach volume 0932a7f4-a646-4455-a1e4-ec89ce3c1deb from mountpoint /dev/vdb
Aug 27 03:46:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Attempting to detach device vdb from instance ed1742b9-a19d-43f9-b39a-7257261f858c from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:46:35 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:46:35 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:46:35 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:46:35 user nova-compute[72990]:   <serial>0932a7f4-a646-4455-a1e4-ec89ce3c1deb</serial>
Aug 27 03:46:35 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:46:35 user nova-compute[72990]: </disk>
Aug 27 03:46:35 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:46:35 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully detached device vdb from instance ed1742b9-a19d-43f9-b39a-7257261f858c from the persistent domain config.
Aug 27 03:46:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiNAcEjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:46:35 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 03:46:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d01869e-2891-4992-a9fd-72aab826eb59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa590a8b-a706-4e9b-8a44-94ba03f6f48a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:46:35 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:46:35 user nova-compute[72990]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:46:35 user nova-compute[72990]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24 (non-flash)
Aug 27 03:46:35 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:46:35 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:46:35 user nova-compute[72990]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:46:35 user nova-compute[72990]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24 (non-flash)
Aug 27 03:46:35 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4432f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba15c3b-34dd-4eeb-b229-4407196fa78b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[40487832-03f2-4c2b-bf09-1b547216f8f5]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f7284b-8e43-4db7-9ace-a2d50c45c0f9]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG nova.compute.manager [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received event network-vif-unplugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:35 user nova-compute[72990]: DEBUG nova.compute.manager [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] No waiting events found dispatching network-vif-unplugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:36 user nova-compute[72990]: WARNING nova.compute.manager [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received unexpected event network-vif-unplugged-9e575e22-6f02-488a-8e18-e9675c3b96ab for instance with vm_state active and task_state rebuilding.
Aug 27 03:46:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received event network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] No waiting events found dispatching network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:36 user nova-compute[72990]: WARNING nova.compute.manager [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received unexpected event network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab for instance with vm_state active and task_state rebuilding.
Aug 27 03:46:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] No waiting events found dispatching network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:36 user nova-compute[72990]: WARNING nova.compute.manager [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received unexpected event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:46:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] No waiting events found dispatching network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:36 user nova-compute[72990]: WARNING nova.compute.manager [req-419f2f4a-c0ec-4f9e-b1d5-bf1e1e5041a1 req-74c67d31-bba2-4599-ae5c-54e66f1e492f service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received unexpected event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4b1814-66c9-4f9f-afbd-c6d0b389899b]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62e5754-ef4f-4a31-9978-196fea9cce30]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9963dba-46fa-4181-b2aa-d4a2e6d7e8a2]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260]
Aug 27 03:46:36 user nova-compute[72990]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260] successful.
Aug 27 03:46:36 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[89986d34-fcf5-4533-923b-f1a1f4e96536]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== disconnect_volume: return (376ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:37 user nova-compute[72990]: INFO nova.compute.manager [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Shelving
Aug 27 03:46:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Instance destroyed successfully.
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1281588218',display_name='tempest-ServerActionsTestOtherA-server-1454386449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1281588218',id=15,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlsSoCaAZImkchManu4IUvMInuwySyWjvM2BnRYj8TwOTjrbfVvrIsy0gRdvaW2QKnHoTyZTaBdUMPbi7bSwOX2IM8E9MHYP+B14NgLPuI0yP5eDhmXA6u6V49C6mCNCw==',key_name='tempest-keypair-67383262',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:44:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-07ekxxya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=ed1742b9-a19d-43f9-b39a-7257261f858c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_vif [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e575e22-6f, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:37 user nova-compute[72990]: INFO os_vif [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f')
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiNAcEjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:46:37 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b9f95f-974a-4222-bc9e-19e7402d52bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bc6be9-6948-4284-9d0e-ae9c4accd84b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:46:37 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:46:37 user nova-compute[72990]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24 (non-flash)
Aug 27 03:46:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:46:37 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:46:37 user nova-compute[72990]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24 (non-flash)
Aug 27 03:46:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44a3400>, {}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Disconnecting from: [] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== disconnect_volume: return (64ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:46:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Deleting instance files /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c_del
Aug 27 03:46:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Deletion of /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c_del complete
Aug 27 03:46:37 user nova-compute[72990]: INFO nova.virt.block_device [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Booting with volume 0932a7f4-a646-4455-a1e4-ec89ce3c1deb at /dev/vdb
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-24b1c4d6-6fcd-4d13-b7d8-ce719f9ea781 req-aa5cc3c9-8d67-474f-abc6-52bfe1c1ed95 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-vif-unplugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-24b1c4d6-6fcd-4d13-b7d8-ce719f9ea781 req-aa5cc3c9-8d67-474f-abc6-52bfe1c1ed95 service nova] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-24b1c4d6-6fcd-4d13-b7d8-ce719f9ea781 req-aa5cc3c9-8d67-474f-abc6-52bfe1c1ed95 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-24b1c4d6-6fcd-4d13-b7d8-ce719f9ea781 req-aa5cc3c9-8d67-474f-abc6-52bfe1c1ed95 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-24b1c4d6-6fcd-4d13-b7d8-ce719f9ea781 req-aa5cc3c9-8d67-474f-abc6-52bfe1c1ed95 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] No waiting events found dispatching network-vif-unplugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:37 user nova-compute[72990]: WARNING nova.compute.manager [req-24b1c4d6-6fcd-4d13-b7d8-ce719f9ea781 req-aa5cc3c9-8d67-474f-abc6-52bfe1c1ed95 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received unexpected event network-vif-unplugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 for instance with vm_state active and task_state shelving.
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.utils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-4c1d0d8a-e687-430a-a9dc-5fea285737f3 tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Removed pending event for 7835f781-b543-4370-922b-3d2a76f9821b due to event {{(pid=72990) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107997.6194205, 7835f781-b543-4370-922b-3d2a76f9821b => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:46:37 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] VM Resumed (Lifecycle Event)
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd42741-a3a4-46fd-80c2-a6f6c6fc178b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8236010b-d73e-45ef-9195-4240b1baba1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0a2cad-a21c-40da-b206-cf4dfcc60c95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d126b71-8ef1-4a21-9187-b246cfc26acc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:46:37 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693107997.6218395, 7835f781-b543-4370-922b-3d2a76f9821b => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:46:37 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] VM Started (Lifecycle Event)
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:46:37 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:46:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2c3302-cff1-4361-887b-42f1e56ce502]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG os_brick.utils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Updating existing volume attachment record: 56350b10-b7e3-434f-bd1c-67063cf29635 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:46:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Instance destroyed successfully.
Aug 27 03:46:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Beginning cold snapshot process
Aug 27 03:46:38 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:46:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk /opt/stack/data/nova/instances/snapshots/tmpow6lxj2u/8841ca6d0ff44222b7e9d41a9d9565d7 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk /opt/stack/data/nova/instances/snapshots/tmpow6lxj2u/8841ca6d0ff44222b7e9d41a9d9565d7" returned: 0 in 0.710s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Snapshot extracted, beginning image upload
Aug 27 03:46:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-68478303-1f52-46bf-bddf-a5f39138bca0 req-777f5ee7-4f4e-425b-9fe3-4c4859fa9172 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-68478303-1f52-46bf-bddf-a5f39138bca0 req-777f5ee7-4f4e-425b-9fe3-4c4859fa9172 service nova] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-68478303-1f52-46bf-bddf-a5f39138bca0 req-777f5ee7-4f4e-425b-9fe3-4c4859fa9172 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-68478303-1f52-46bf-bddf-a5f39138bca0 req-777f5ee7-4f4e-425b-9fe3-4c4859fa9172 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-68478303-1f52-46bf-bddf-a5f39138bca0 req-777f5ee7-4f4e-425b-9fe3-4c4859fa9172 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] No waiting events found dispatching network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:39 user nova-compute[72990]: WARNING nova.compute.manager [req-68478303-1f52-46bf-bddf-a5f39138bca0 req-777f5ee7-4f4e-425b-9fe3-4c4859fa9172 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received unexpected event network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 for instance with vm_state active and task_state shelving_image_uploading.
Aug 27 03:46:42 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Snapshot image upload complete
Aug 27 03:46:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:42 user nova-compute[72990]: INFO nova.compute.manager [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Shelve offloading
Aug 27 03:46:42 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Instance destroyed successfully.
Aug 27 03:46:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:46:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquired lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:46:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:46:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updating instance_info_cache with network_info: [{"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:46:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Releasing lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:46:43 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Instance destroyed successfully.
Aug 27 03:46:43 user nova-compute[72990]: DEBUG nova.objects.instance [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'resources' on Instance uuid 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:44:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-540718096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-540718096',id=16,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT6IrDqHUyj+WWqRbXtufrlRqRkgo3D56ibga6nfxeKOdSyMT8pY8NCJaScOf+GpkgEwVia9hfEYPOo+O3C0AiPNser5LSpeMDp9MmOv0BFJxJBFs/HXMLQxNaegz6f0w==',key_name='tempest-keypair-1260377371',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:44:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bd44d92dded643eb89d955dbf6b4d1e3',ramdisk_id='',reservation_id='r-s07xb5he',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2085503517',owner_user_name='tempest-AttachVolumeShelveTestJSON-2085503517-project-member',shelved_at='2023-08-27T03:46:42.042759',shelved_host='user',shelved_image_id='02ba5bab-59e1-43c3-bcd1-ee5ac0dea1ac'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be8e872f1de4248a557155ff1c4f5ec',uuid=1e81de88-259e-4124-8e2c-cafd310a9b42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converting VIF {"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG os_vif [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf875fdb9-c3, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:46:44 user nova-compute[72990]: INFO os_vif [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3')
Aug 27 03:46:44 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Deleting instance files /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42_del
Aug 27 03:46:44 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Deletion of /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42_del complete
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-695c7b57-9b4f-470b-806a-5a79918a5a17 req-05119c49-f66c-4dfb-a6be-50f096344ed5 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-changed-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-695c7b57-9b4f-470b-806a-5a79918a5a17 req-05119c49-f66c-4dfb-a6be-50f096344ed5 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Refreshing instance network info cache due to event network-changed-f875fdb9-c314-4ded-9793-cb49e10bbdd8. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-695c7b57-9b4f-470b-806a-5a79918a5a17 req-05119c49-f66c-4dfb-a6be-50f096344ed5 service nova] Acquiring lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-695c7b57-9b4f-470b-806a-5a79918a5a17 req-05119c49-f66c-4dfb-a6be-50f096344ed5 service nova] Acquired lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.network.neutron [req-695c7b57-9b4f-470b-806a-5a79918a5a17 req-05119c49-f66c-4dfb-a6be-50f096344ed5 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Refreshing network info cache for port f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:46:44 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Deleted allocations for instance 1e81de88-259e-4124-8e2c-cafd310a9b42
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.objects.instance [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.objects.base [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Object Instance<1e81de88-259e-4124-8e2c-cafd310a9b42> lazy-loaded attributes: resources,numa_topology {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693107989.2991354, 970ca110-30d7-4e41-92d3-aa4e0bda4482 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:46:44 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] VM Stopped (Lifecycle Event)
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f48cfc65-483a-4ced-8064-26a558aed196 None None] [instance: 970ca110-30d7-4e41-92d3-aa4e0bda4482] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.network.neutron [req-695c7b57-9b4f-470b-806a-5a79918a5a17 req-05119c49-f66c-4dfb-a6be-50f096344ed5 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updated VIF entry in instance network info cache for port f875fdb9-c314-4ded-9793-cb49e10bbdd8. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.network.neutron [req-695c7b57-9b4f-470b-806a-5a79918a5a17 req-05119c49-f66c-4dfb-a6be-50f096344ed5 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updating instance_info_cache with network_info: [{"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-695c7b57-9b4f-470b-806a-5a79918a5a17 req-05119c49-f66c-4dfb-a6be-50f096344ed5 service nova] Releasing lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:44 user nova-compute[72990]: WARNING nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] While synchronizing instance power states, found 11 instances in the database and 9 instances on the hypervisor.
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 034cb1d6-25b5-499d-81b1-36adf2385242 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid bcd09a59-c950-4143-bfc8-9a89705cca8c {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid bc82cced-9f16-44bc-b9bc-622fa99b1be0 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 7114903d-465a-4ef6-b436-88af52261eae {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid f8dc092c-cd9d-417c-9c70-b805d59b6116 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 338682cb-8c70-49c3-b88c-362e96ec8fb1 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid ed1742b9-a19d-43f9-b39a-7257261f858c {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "ca203604-996d-4558-9857-df9e2001c319" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "034cb1d6-25b5-499d-81b1-36adf2385242" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "034cb1d6-25b5-499d-81b1-36adf2385242" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "7835f781-b543-4370-922b-3d2a76f9821b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "bcd09a59-c950-4143-bfc8-9a89705cca8c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "7114903d-465a-4ef6-b436-88af52261eae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:44 user nova-compute[72990]: INFO nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d6517061-d862-4383-96cb-745f2040cf74 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.802s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.019s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:44 user nova-compute[72990]: WARNING oslo_messaging._drivers.amqpdriver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "ca203604-996d-4558-9857-df9e2001c319" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "034cb1d6-25b5-499d-81b1-36adf2385242" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:44 user nova-compute[72990]: INFO nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] During the sync_power process the instance has moved from host None to host user
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "7835f781-b543-4370-922b-3d2a76f9821b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.160s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "7114903d-465a-4ef6-b436-88af52261eae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.182s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.200s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:50 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693107995.4773657, ed1742b9-a19d-43f9-b39a-7257261f858c => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:46:50 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] VM Stopped (Lifecycle Event)
Aug 27 03:46:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a938285b-d70c-4d43-a33c-da8bf674e254 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:46:51 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Creating image(s)
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "/opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "/opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.238s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk 1073741824" returned: 0 in 0.065s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.194s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Cannot resize image /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Ensure instance console log exists: /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Start _get_guest_xml network_info=[{"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '56350b10-b7e3-434f-bd1c-67063cf29635', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiNAcEjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed1742b9-a19d-43f9-b39a-7257261f858c', 'attached_at': '', 'detached_at': '', 'volume_id': '0932a7f4-a646-4455-a1e4-ec89ce3c1deb', 'serial': '0932a7f4-a646-4455-a1e4-ec89ce3c1deb'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:46:52 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 03:46:52 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed1742b9-a19d-43f9-b39a-7257261f858c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiNAcEjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:46:52 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:46:52 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:46:52 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd761730-edb8-4cfe-a572-5463e115e4ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:46:52 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d5d95b-b78d-47df-8ef9-eb9351aed4b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb] added
Aug 27 03:46:52 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b56c41-8f6b-4413-978e-b726ba0960d1]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c6a101-0023-4c52-ad60-0495f940ff35]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KiNAcEjm {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KiNAcEjm" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[da801798-3c1a-4066-91a4-2f59d525c533]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KiNAcEjm'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[371d478a-af6f-46c9-b165-ca78039cd5d0]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f010068-ecc0-488a-8b3c-bf98c17ee966]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71374274-f990-4592-8874-7452c191845c (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24 (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71374274-f990-4592-8874-7452c191845c (non-flash)
Aug 27 03:46:52 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24 (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71374274-f990-4592-8874-7452c191845c (non-flash)
Aug 27 03:46:52 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6054556e-0c4f-4fc4-af4b-0d59e1042c65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260]
Aug 27 03:46:52 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260] successful.
Aug 27 03:46:52 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed688ed-e946-4615-8605-fe6228415a4f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[863de961-e0a5-48c3-99c3-7de0d35ef5d5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71374274-f990-4592-8874-7452c191845c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24 (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71374274-f990-4592-8874-7452c191845c (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:46:52 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:355210a1-ee28-4b62-8c31-5eb6d43b6b24 (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71374274-f990-4592-8874-7452c191845c (non-flash)
Aug 27 03:46:52 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:46:52 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e440cc1c-7ae5-47c2-a418-a547de95e43a]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693107997.911143, 1e81de88-259e-4124-8e2c-cafd310a9b42 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:46:52 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] VM Stopped (Lifecycle Event)
Aug 27 03:46:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7df81806-396e-4972-a42d-8acdc9f9d197 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiNAcEjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26663393061666339', 'path': '/dev/sdd'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663393061666339', 'path': '/dev/sdd'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1281588218',display_name='tempest-ServerActionsTestOtherA-server-1454386449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1281588218',id=15,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlsSoCaAZImkchManu4IUvMInuwySyWjvM2BnRYj8TwOTjrbfVvrIsy0gRdvaW2QKnHoTyZTaBdUMPbi7bSwOX2IM8E9MHYP+B14NgLPuI0yP5eDhmXA6u6V49C6mCNCw==',key_name='tempest-keypair-67383262',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:44:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-07ekxxya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:46:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=ed1742b9-a19d-43f9-b39a-7257261f858c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:46:53 user nova-compute[72990]:   <uuid>ed1742b9-a19d-43f9-b39a-7257261f858c</uuid>
Aug 27 03:46:53 user nova-compute[72990]:   <name>instance-0000000f</name>
Aug 27 03:46:53 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:46:53 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:46:53 user nova-compute[72990]:   <metadata>
Aug 27 03:46:53 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:46:53 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:46:53 user nova-compute[72990]:       <nova:name>tempest-ServerActionsTestOtherA-server-1454386449</nova:name>
Aug 27 03:46:53 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:46:52</nova:creationTime>
Aug 27 03:46:53 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:46:53 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:46:53 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:46:53 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:46:53 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:46:53 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:46:53 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:46:53 user nova-compute[72990]:       <nova:owner>
Aug 27 03:46:53 user nova-compute[72990]:         <nova:user uuid="cb95e31732904174a8ebddf48c6426ed">tempest-ServerActionsTestOtherA-938526966-project-member</nova:user>
Aug 27 03:46:53 user nova-compute[72990]:         <nova:project uuid="2282ed15ca724f029c368c8a5ce0f268">tempest-ServerActionsTestOtherA-938526966</nova:project>
Aug 27 03:46:53 user nova-compute[72990]:       </nova:owner>
Aug 27 03:46:53 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:46:53 user nova-compute[72990]:       <nova:ports>
Aug 27 03:46:53 user nova-compute[72990]:         <nova:port uuid="9e575e22-6f02-488a-8e18-e9675c3b96ab">
Aug 27 03:46:53 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 03:46:53 user nova-compute[72990]:         </nova:port>
Aug 27 03:46:53 user nova-compute[72990]:       </nova:ports>
Aug 27 03:46:53 user nova-compute[72990]:     </nova:instance>
Aug 27 03:46:53 user nova-compute[72990]:   </metadata>
Aug 27 03:46:53 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:46:53 user nova-compute[72990]:     <system>
Aug 27 03:46:53 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:46:53 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:46:53 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:46:53 user nova-compute[72990]:       <entry name="serial">ed1742b9-a19d-43f9-b39a-7257261f858c</entry>
Aug 27 03:46:53 user nova-compute[72990]:       <entry name="uuid">ed1742b9-a19d-43f9-b39a-7257261f858c</entry>
Aug 27 03:46:53 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:46:53 user nova-compute[72990]:     </system>
Aug 27 03:46:53 user nova-compute[72990]:   </sysinfo>
Aug 27 03:46:53 user nova-compute[72990]:   <os>
Aug 27 03:46:53 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:46:53 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:46:53 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:46:53 user nova-compute[72990]:   </os>
Aug 27 03:46:53 user nova-compute[72990]:   <features>
Aug 27 03:46:53 user nova-compute[72990]:     <acpi/>
Aug 27 03:46:53 user nova-compute[72990]:     <apic/>
Aug 27 03:46:53 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:46:53 user nova-compute[72990]:   </features>
Aug 27 03:46:53 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:46:53 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:46:53 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:46:53 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:46:53 user nova-compute[72990]:   </clock>
Aug 27 03:46:53 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:46:53 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:46:53 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:46:53 user nova-compute[72990]:   </cpu>
Aug 27 03:46:53 user nova-compute[72990]:   <devices>
Aug 27 03:46:53 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:46:53 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:46:53 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk"/>
Aug 27 03:46:53 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:46:53 user nova-compute[72990]:     </disk>
Aug 27 03:46:53 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:46:53 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:46:53 user nova-compute[72990]:       <source dev="/dev/sdd"/>
Aug 27 03:46:53 user nova-compute[72990]:       <target dev="vdb" bus="virtio"/>
Aug 27 03:46:53 user nova-compute[72990]:       <serial>0932a7f4-a646-4455-a1e4-ec89ce3c1deb</serial>
Aug 27 03:46:53 user nova-compute[72990]:     </disk>
Aug 27 03:46:53 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:46:53 user nova-compute[72990]:       <mac address="fa:16:3e:07:eb:d3"/>
Aug 27 03:46:53 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:46:53 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:46:53 user nova-compute[72990]:       <target dev="tap9e575e22-6f"/>
Aug 27 03:46:53 user nova-compute[72990]:     </interface>
Aug 27 03:46:53 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:46:53 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/console.log" append="off"/>
Aug 27 03:46:53 user nova-compute[72990]:     </serial>
Aug 27 03:46:53 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:46:53 user nova-compute[72990]:     <video>
Aug 27 03:46:53 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:46:53 user nova-compute[72990]:     </video>
Aug 27 03:46:53 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:46:53 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:46:53 user nova-compute[72990]:     </rng>
Aug 27 03:46:53 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:46:53 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:46:53 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:46:53 user nova-compute[72990]:     </memballoon>
Aug 27 03:46:53 user nova-compute[72990]:   </devices>
Aug 27 03:46:53 user nova-compute[72990]: </domain>
Aug 27 03:46:53 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1281588218',display_name='tempest-ServerActionsTestOtherA-server-1454386449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1281588218',id=15,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlsSoCaAZImkchManu4IUvMInuwySyWjvM2BnRYj8TwOTjrbfVvrIsy0gRdvaW2QKnHoTyZTaBdUMPbi7bSwOX2IM8E9MHYP+B14NgLPuI0yP5eDhmXA6u6V49C6mCNCw==',key_name='tempest-keypair-67383262',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:44:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-07ekxxya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:46:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=ed1742b9-a19d-43f9-b39a-7257261f858c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG os_vif [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e575e22-6f, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e575e22-6f, col_values=(('external_ids', {'iface-id': '9e575e22-6f02-488a-8e18-e9675c3b96ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:eb:d3', 'vm-uuid': 'ed1742b9-a19d-43f9-b39a-7257261f858c'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:53 user nova-compute[72990]: INFO os_vif [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f')
Aug 27 03:46:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:46:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No VIF found with MAC fa:16:3e:07:eb:d3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:46:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-02b80d90-dd06-4a9c-98ab-765e356ed30d req-5e5f5c17-55e4-4348-8a2a-5be1f815bccc service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received event network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-02b80d90-dd06-4a9c-98ab-765e356ed30d req-5e5f5c17-55e4-4348-8a2a-5be1f815bccc service nova] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-02b80d90-dd06-4a9c-98ab-765e356ed30d req-5e5f5c17-55e4-4348-8a2a-5be1f815bccc service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-02b80d90-dd06-4a9c-98ab-765e356ed30d req-5e5f5c17-55e4-4348-8a2a-5be1f815bccc service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-02b80d90-dd06-4a9c-98ab-765e356ed30d req-5e5f5c17-55e4-4348-8a2a-5be1f815bccc service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] No waiting events found dispatching network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:55 user nova-compute[72990]: WARNING nova.compute.manager [req-02b80d90-dd06-4a9c-98ab-765e356ed30d req-5e5f5c17-55e4-4348-8a2a-5be1f815bccc service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received unexpected event network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab for instance with vm_state active and task_state rebuild_spawning.
Aug 27 03:46:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108017.5715277, ed1742b9-a19d-43f9-b39a-7257261f858c => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:46:57 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] VM Resumed (Lifecycle Event)
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:46:57 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Instance spawned successfully.
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:46:57 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108017.5749419, ed1742b9-a19d-43f9-b39a-7257261f858c => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:46:57 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] VM Started (Lifecycle Event)
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:46:57 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72990) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.compute.manager [req-8176e52e-e63b-4ff4-939b-649e3017d400 req-c58a8873-6213-4f88-bdb6-4340ab7a466f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received event network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8176e52e-e63b-4ff4-939b-649e3017d400 req-c58a8873-6213-4f88-bdb6-4340ab7a466f service nova] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8176e52e-e63b-4ff4-939b-649e3017d400 req-c58a8873-6213-4f88-bdb6-4340ab7a466f service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8176e52e-e63b-4ff4-939b-649e3017d400 req-c58a8873-6213-4f88-bdb6-4340ab7a466f service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:57 user nova-compute[72990]: DEBUG nova.compute.manager [req-8176e52e-e63b-4ff4-939b-649e3017d400 req-c58a8873-6213-4f88-bdb6-4340ab7a466f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] No waiting events found dispatching network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:46:57 user nova-compute[72990]: WARNING nova.compute.manager [req-8176e52e-e63b-4ff4-939b-649e3017d400 req-c58a8873-6213-4f88-bdb6-4340ab7a466f service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received unexpected event network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab for instance with vm_state active and task_state None.
Aug 27 03:46:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c0ea9a32-feda-4743-8aca-309b5db86d3a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:46:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:03 user nova-compute[72990]: INFO nova.compute.manager [None req-e470c51b-173a-4dd4-9480-abfe3acc4f0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Unrescuing
Aug 27 03:47:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e470c51b-173a-4dd4-9480-abfe3acc4f0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:47:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e470c51b-173a-4dd4-9480-abfe3acc4f0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquired lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:47:03 user nova-compute[72990]: DEBUG nova.network.neutron [None req-e470c51b-173a-4dd4-9480-abfe3acc4f0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:47:04 user nova-compute[72990]: DEBUG nova.network.neutron [None req-e470c51b-173a-4dd4-9480-abfe3acc4f0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Updating instance_info_cache with network_info: [{"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:47:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e470c51b-173a-4dd4-9480-abfe3acc4f0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Releasing lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:47:04 user nova-compute[72990]: DEBUG nova.objects.instance [None req-e470c51b-173a-4dd4-9480-abfe3acc4f0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'flavor' on Instance uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:47:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:04 user nova-compute[72990]: INFO nova.compute.manager [None req-bb53169a-9023-4f49-98b2-5372bcda4527 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Unrescuing
Aug 27 03:47:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-bb53169a-9023-4f49-98b2-5372bcda4527 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:47:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-bb53169a-9023-4f49-98b2-5372bcda4527 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquired lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:47:04 user nova-compute[72990]: DEBUG nova.network.neutron [None req-bb53169a-9023-4f49-98b2-5372bcda4527 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:47:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-9dd8d5e7-9986-43e7-a4e0-0ef5b8f7d185 req-5060fa43-9c7b-4cb0-b184-9c8e8078a290 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-unplugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9dd8d5e7-9986-43e7-a4e0-0ef5b8f7d185 req-5060fa43-9c7b-4cb0-b184-9c8e8078a290 service nova] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9dd8d5e7-9986-43e7-a4e0-0ef5b8f7d185 req-5060fa43-9c7b-4cb0-b184-9c8e8078a290 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9dd8d5e7-9986-43e7-a4e0-0ef5b8f7d185 req-5060fa43-9c7b-4cb0-b184-9c8e8078a290 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-9dd8d5e7-9986-43e7-a4e0-0ef5b8f7d185 req-5060fa43-9c7b-4cb0-b184-9c8e8078a290 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] No waiting events found dispatching network-vif-unplugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:05 user nova-compute[72990]: WARNING nova.compute.manager [req-9dd8d5e7-9986-43e7-a4e0-0ef5b8f7d185 req-5060fa43-9c7b-4cb0-b184-9c8e8078a290 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received unexpected event network-vif-unplugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:47:05 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: ca203604-996d-4558-9857-df9e2001c319] Instance destroyed successfully.
Aug 27 03:47:05 user nova-compute[72990]: DEBUG nova.network.neutron [None req-bb53169a-9023-4f49-98b2-5372bcda4527 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Updating instance_info_cache with network_info: [{"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:47:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-bb53169a-9023-4f49-98b2-5372bcda4527 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Releasing lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:47:05 user nova-compute[72990]: DEBUG nova.objects.instance [None req-bb53169a-9023-4f49-98b2-5372bcda4527 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'flavor' on Instance uuid 7114903d-465a-4ef6-b436-88af52261eae {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:47:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:06 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a401057-8999-466f-8e55-2402c67e9d19 req-1da7c27c-8ee7-4058-b402-acc1a3a46a54 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-unplugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a401057-8999-466f-8e55-2402c67e9d19 req-1da7c27c-8ee7-4058-b402-acc1a3a46a54 service nova] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a401057-8999-466f-8e55-2402c67e9d19 req-1da7c27c-8ee7-4058-b402-acc1a3a46a54 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a401057-8999-466f-8e55-2402c67e9d19 req-1da7c27c-8ee7-4058-b402-acc1a3a46a54 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:06 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a401057-8999-466f-8e55-2402c67e9d19 req-1da7c27c-8ee7-4058-b402-acc1a3a46a54 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] No waiting events found dispatching network-vif-unplugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:06 user nova-compute[72990]: WARNING nova.compute.manager [req-0a401057-8999-466f-8e55-2402c67e9d19 req-1da7c27c-8ee7-4058-b402-acc1a3a46a54 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received unexpected event network-vif-unplugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:47:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:07 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Instance destroyed successfully.
Aug 27 03:47:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-c99b9b6a-ab57-44ec-aee8-6becb3764235 req-86a129e1-c46a-4c59-a4dc-15e9750c1bcc service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c99b9b6a-ab57-44ec-aee8-6becb3764235 req-86a129e1-c46a-4c59-a4dc-15e9750c1bcc service nova] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c99b9b6a-ab57-44ec-aee8-6becb3764235 req-86a129e1-c46a-4c59-a4dc-15e9750c1bcc service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c99b9b6a-ab57-44ec-aee8-6becb3764235 req-86a129e1-c46a-4c59-a4dc-15e9750c1bcc service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-c99b9b6a-ab57-44ec-aee8-6becb3764235 req-86a129e1-c46a-4c59-a4dc-15e9750c1bcc service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] No waiting events found dispatching network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:07 user nova-compute[72990]: WARNING nova.compute.manager [req-c99b9b6a-ab57-44ec-aee8-6becb3764235 req-86a129e1-c46a-4c59-a4dc-15e9750c1bcc service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received unexpected event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:47:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-cc821c23-e186-423f-99b0-9b4de528ab48 req-bac55d27-0eab-4267-b80f-ec5d9748f6cb service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cc821c23-e186-423f-99b0-9b4de528ab48 req-bac55d27-0eab-4267-b80f-ec5d9748f6cb service nova] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cc821c23-e186-423f-99b0-9b4de528ab48 req-bac55d27-0eab-4267-b80f-ec5d9748f6cb service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cc821c23-e186-423f-99b0-9b4de528ab48 req-bac55d27-0eab-4267-b80f-ec5d9748f6cb service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-cc821c23-e186-423f-99b0-9b4de528ab48 req-bac55d27-0eab-4267-b80f-ec5d9748f6cb service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] No waiting events found dispatching network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:08 user nova-compute[72990]: WARNING nova.compute.manager [req-cc821c23-e186-423f-99b0-9b4de528ab48 req-bac55d27-0eab-4267-b80f-ec5d9748f6cb service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received unexpected event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:47:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-63d27e14-a9cc-44ef-b54c-4a741fa83633 req-56a25f82-5fd0-4b84-a0c2-d2f0f6beda84 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63d27e14-a9cc-44ef-b54c-4a741fa83633 req-56a25f82-5fd0-4b84-a0c2-d2f0f6beda84 service nova] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63d27e14-a9cc-44ef-b54c-4a741fa83633 req-56a25f82-5fd0-4b84-a0c2-d2f0f6beda84 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63d27e14-a9cc-44ef-b54c-4a741fa83633 req-56a25f82-5fd0-4b84-a0c2-d2f0f6beda84 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-63d27e14-a9cc-44ef-b54c-4a741fa83633 req-56a25f82-5fd0-4b84-a0c2-d2f0f6beda84 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] No waiting events found dispatching network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:09 user nova-compute[72990]: WARNING nova.compute.manager [req-63d27e14-a9cc-44ef-b54c-4a741fa83633 req-56a25f82-5fd0-4b84-a0c2-d2f0f6beda84 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received unexpected event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:47:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-63d27e14-a9cc-44ef-b54c-4a741fa83633 req-56a25f82-5fd0-4b84-a0c2-d2f0f6beda84 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63d27e14-a9cc-44ef-b54c-4a741fa83633 req-56a25f82-5fd0-4b84-a0c2-d2f0f6beda84 service nova] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63d27e14-a9cc-44ef-b54c-4a741fa83633 req-56a25f82-5fd0-4b84-a0c2-d2f0f6beda84 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63d27e14-a9cc-44ef-b54c-4a741fa83633 req-56a25f82-5fd0-4b84-a0c2-d2f0f6beda84 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-63d27e14-a9cc-44ef-b54c-4a741fa83633 req-56a25f82-5fd0-4b84-a0c2-d2f0f6beda84 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] No waiting events found dispatching network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:09 user nova-compute[72990]: WARNING nova.compute.manager [req-63d27e14-a9cc-44ef-b54c-4a741fa83633 req-56a25f82-5fd0-4b84-a0c2-d2f0f6beda84 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received unexpected event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:47:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-33a91aab-7fe9-440e-bc66-f25fb0d1bcfc req-8c202ae7-0b4d-4d2c-9b64-f17405f12a85 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-33a91aab-7fe9-440e-bc66-f25fb0d1bcfc req-8c202ae7-0b4d-4d2c-9b64-f17405f12a85 service nova] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-33a91aab-7fe9-440e-bc66-f25fb0d1bcfc req-8c202ae7-0b4d-4d2c-9b64-f17405f12a85 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-33a91aab-7fe9-440e-bc66-f25fb0d1bcfc req-8c202ae7-0b4d-4d2c-9b64-f17405f12a85 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-33a91aab-7fe9-440e-bc66-f25fb0d1bcfc req-8c202ae7-0b4d-4d2c-9b64-f17405f12a85 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] No waiting events found dispatching network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:10 user nova-compute[72990]: WARNING nova.compute.manager [req-33a91aab-7fe9-440e-bc66-f25fb0d1bcfc req-8c202ae7-0b4d-4d2c-9b64-f17405f12a85 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received unexpected event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:47:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-33a91aab-7fe9-440e-bc66-f25fb0d1bcfc req-8c202ae7-0b4d-4d2c-9b64-f17405f12a85 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-33a91aab-7fe9-440e-bc66-f25fb0d1bcfc req-8c202ae7-0b4d-4d2c-9b64-f17405f12a85 service nova] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-33a91aab-7fe9-440e-bc66-f25fb0d1bcfc req-8c202ae7-0b4d-4d2c-9b64-f17405f12a85 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-33a91aab-7fe9-440e-bc66-f25fb0d1bcfc req-8c202ae7-0b4d-4d2c-9b64-f17405f12a85 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-33a91aab-7fe9-440e-bc66-f25fb0d1bcfc req-8c202ae7-0b4d-4d2c-9b64-f17405f12a85 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] No waiting events found dispatching network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:10 user nova-compute[72990]: WARNING nova.compute.manager [req-33a91aab-7fe9-440e-bc66-f25fb0d1bcfc req-8c202ae7-0b4d-4d2c-9b64-f17405f12a85 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received unexpected event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Removed pending event for ca203604-996d-4558-9857-df9e2001c319 due to event {{(pid=72990) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108031.1583564, ca203604-996d-4558-9857-df9e2001c319 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:47:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] VM Resumed (Lifecycle Event)
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-e470c51b-173a-4dd4-9480-abfe3acc4f0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108031.1618779, ca203604-996d-4558-9857-df9e2001c319 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:47:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] VM Started (Lifecycle Event)
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Removed pending event for 7114903d-465a-4ef6-b436-88af52261eae due to event {{(pid=72990) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108031.744694, 7114903d-465a-4ef6-b436-88af52261eae => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:47:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] VM Resumed (Lifecycle Event)
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-bb53169a-9023-4f49-98b2-5372bcda4527 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:47:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108031.7486057, 7114903d-465a-4ef6-b436-88af52261eae => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:47:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] VM Started (Lifecycle Event)
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:47:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:47:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:13 user nova-compute[72990]: INFO nova.compute.manager [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Terminating instance
Aug 27 03:47:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:47:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-bbdff1f0-7804-489f-9c7f-35a51f423803 req-4e1c98fe-2d79-4783-ae29-b1d84ad6b20b service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-vif-unplugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bbdff1f0-7804-489f-9c7f-35a51f423803 req-4e1c98fe-2d79-4783-ae29-b1d84ad6b20b service nova] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bbdff1f0-7804-489f-9c7f-35a51f423803 req-4e1c98fe-2d79-4783-ae29-b1d84ad6b20b service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bbdff1f0-7804-489f-9c7f-35a51f423803 req-4e1c98fe-2d79-4783-ae29-b1d84ad6b20b service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-bbdff1f0-7804-489f-9c7f-35a51f423803 req-4e1c98fe-2d79-4783-ae29-b1d84ad6b20b service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] No waiting events found dispatching network-vif-unplugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-bbdff1f0-7804-489f-9c7f-35a51f423803 req-4e1c98fe-2d79-4783-ae29-b1d84ad6b20b service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-vif-unplugged-48bea006-1d46-416d-8ab6-99617cdbcb63 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Instance destroyed successfully.
Aug 27 03:47:14 user nova-compute[72990]: DEBUG nova.objects.instance [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lazy-loading 'resources' on Instance uuid bc82cced-9f16-44bc-b9bc-622fa99b1be0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-224545468',display_name='tempest-VolumesAdminNegativeTest-server-224545468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-224545468',id=8,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrvMAWrGSE690SJX2UCJTWj4tFHLTkqnANgUuE1tSUDNQCinv6wyWDM47ESyj9c8qsCifoP2Rh7NNqP2Ujug6A7kim22xdnbYKWOqyYz2HtCUgzmsanWy20N9Ph25x7jw==',key_name='tempest-keypair-1596844096',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c8ee9d65a3449cc8793fe94beb962b9',ramdisk_id='',reservation_id='r-on494m0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1331051968',owner_user_name='tempest-VolumesAdminNegativeTest-1331051968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:41:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70e76f4237f8491da1a1003787625936',uuid=bc82cced-9f16-44bc-b9bc-622fa99b1be0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48bea006-1d46-416d-8ab6-99617cdbcb63", "address": "fa:16:3e:b7:4e:53", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bea006-1d", "ovs_interfaceid": "48bea006-1d46-416d-8ab6-99617cdbcb63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Converting VIF {"id": "48bea006-1d46-416d-8ab6-99617cdbcb63", "address": "fa:16:3e:b7:4e:53", "network": {"id": "0181abae-26a5-42c2-ba6f-2da1588a29c1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4742535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8ee9d65a3449cc8793fe94beb962b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bea006-1d", "ovs_interfaceid": "48bea006-1d46-416d-8ab6-99617cdbcb63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=48bea006-1d46-416d-8ab6-99617cdbcb63,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bea006-1d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG os_vif [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=48bea006-1d46-416d-8ab6-99617cdbcb63,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bea006-1d') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48bea006-1d, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:14 user nova-compute[72990]: INFO os_vif [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=48bea006-1d46-416d-8ab6-99617cdbcb63,network=Network(0181abae-26a5-42c2-ba6f-2da1588a29c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bea006-1d')
Aug 27 03:47:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Deleting instance files /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0_del
Aug 27 03:47:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Deletion of /opt/stack/data/nova/instances/bc82cced-9f16-44bc-b9bc-622fa99b1be0_del complete
Aug 27 03:47:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:14 user nova-compute[72990]: INFO nova.compute.manager [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 27 03:47:14 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:47:14 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:47:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:15 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:47:16 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Took 1.35 seconds to deallocate network for instance.
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-bb253b62-7aec-480f-9464-8c3758de3a60 req-81dd14ee-04f6-4c41-a0d9-573a32a1ade3 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-vif-deleted-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] No waiting events found dispatching network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:16 user nova-compute[72990]: WARNING nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received unexpected event network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 for instance with vm_state active and task_state deleting.
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] No waiting events found dispatching network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:16 user nova-compute[72990]: WARNING nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received unexpected event network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 for instance with vm_state active and task_state deleting.
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] No waiting events found dispatching network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:16 user nova-compute[72990]: WARNING nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received unexpected event network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 for instance with vm_state active and task_state deleting.
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-vif-unplugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] No waiting events found dispatching network-vif-unplugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-vif-unplugged-48bea006-1d46-416d-8ab6-99617cdbcb63 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received event network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Acquiring lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] No waiting events found dispatching network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:16 user nova-compute[72990]: WARNING nova.compute.manager [req-03261fd9-47e2-4f2e-87c5-6f2c4f01fe52 req-3243795b-5fe7-4545-a8bf-3d3ea1e22aa6 service nova] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Received unexpected event network-vif-plugged-48bea006-1d46-416d-8ab6-99617cdbcb63 for instance with vm_state active and task_state deleting.
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:16 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Deleted allocations for instance bc82cced-9f16-44bc-b9bc-622fa99b1be0
Aug 27 03:47:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-561d4be3-e985-4165-81b6-7bc9f70bee40 tempest-VolumesAdminNegativeTest-1331051968 tempest-VolumesAdminNegativeTest-1331051968-project-member] Lock "bc82cced-9f16-44bc-b9bc-622fa99b1be0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.035s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:20 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:47:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:22 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:47:22 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:47:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:47:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "9052a337-efb8-4a79-95c1-685d22966cec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "9052a337-efb8-4a79-95c1-685d22966cec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:47:23 user nova-compute[72990]: INFO nova.compute.claims [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Claim successful on node user
Aug 27 03:47:23 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:47:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:47:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG nova.policy [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e7d2fc4d4204ad38d0d11376de45bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd007a65dbbce40729d2d7a25561a4f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:47:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Creating image(s)
Aug 27 03:47:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "/opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "/opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "/opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.204s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.216s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk 1073741824" returned: 0 in 0.058s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Cannot resize image /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Ensure instance console log exists: /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Successfully created port: ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:47:25 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:47:25 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:47:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:25 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:47:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Successfully updated port: ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "refresh_cache-9052a337-efb8-4a79-95c1-685d22966cec" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquired lock "refresh_cache-9052a337-efb8-4a79-95c1-685d22966cec" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-1814aac1-728f-451d-9507-ea13cf53c52d req-3392eb09-2dfb-435f-a826-3a73d9ab49b5 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Received event network-changed-ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-1814aac1-728f-451d-9507-ea13cf53c52d req-3392eb09-2dfb-435f-a826-3a73d9ab49b5 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Refreshing instance network info cache due to event network-changed-ed0518e1-05ee-4dde-b386-b83977c4872c. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1814aac1-728f-451d-9507-ea13cf53c52d req-3392eb09-2dfb-435f-a826-3a73d9ab49b5 service nova] Acquiring lock "refresh_cache-9052a337-efb8-4a79-95c1-685d22966cec" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Updating instance_info_cache with network_info: [{"id": "ed0518e1-05ee-4dde-b386-b83977c4872c", "address": "fa:16:3e:c9:9e:a3", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0518e1-05", "ovs_interfaceid": "ed0518e1-05ee-4dde-b386-b83977c4872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Releasing lock "refresh_cache-9052a337-efb8-4a79-95c1-685d22966cec" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Instance network_info: |[{"id": "ed0518e1-05ee-4dde-b386-b83977c4872c", "address": "fa:16:3e:c9:9e:a3", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0518e1-05", "ovs_interfaceid": "ed0518e1-05ee-4dde-b386-b83977c4872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1814aac1-728f-451d-9507-ea13cf53c52d req-3392eb09-2dfb-435f-a826-3a73d9ab49b5 service nova] Acquired lock "refresh_cache-9052a337-efb8-4a79-95c1-685d22966cec" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-1814aac1-728f-451d-9507-ea13cf53c52d req-3392eb09-2dfb-435f-a826-3a73d9ab49b5 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Refreshing network info cache for port ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Start _get_guest_xml network_info=[{"id": "ed0518e1-05ee-4dde-b386-b83977c4872c", "address": "fa:16:3e:c9:9e:a3", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0518e1-05", "ovs_interfaceid": "ed0518e1-05ee-4dde-b386-b83977c4872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:47:26 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:47:26 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1844801511',display_name='tempest-AttachVolumeNegativeTest-server-1844801511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1844801511',id=19,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtzJe4pwiGtzii4pfCo8neGv61D2bhbkP+CCXV6bq46JzYeYLsAOFCkle3MKvfFwhQ1DdIBsczmoD6qUTsDkAVxj/p9u8fy/qrF5qwOjMvO6z2n6Fa4Sbb7D7VO4TQpaA==',key_name='tempest-keypair-2125464292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d007a65dbbce40729d2d7a25561a4f91',ramdisk_id='',reservation_id='r-vel7i9p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-945598863',owner_user_name='tempest-AttachVolumeNegativeTest-945598863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7d2fc4d4204ad38d0d11376de45bd6',uuid=9052a337-efb8-4a79-95c1-685d22966cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed0518e1-05ee-4dde-b386-b83977c4872c", "address": "fa:16:3e:c9:9e:a3", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0518e1-05", "ovs_interfaceid": "ed0518e1-05ee-4dde-b386-b83977c4872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converting VIF {"id": "ed0518e1-05ee-4dde-b386-b83977c4872c", "address": "fa:16:3e:c9:9e:a3", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0518e1-05", "ovs_interfaceid": "ed0518e1-05ee-4dde-b386-b83977c4872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9e:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed0518e1-05ee-4dde-b386-b83977c4872c,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0518e1-05') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.objects.instance [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'pci_devices' on Instance uuid 9052a337-efb8-4a79-95c1-685d22966cec {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:47:26 user nova-compute[72990]:   <uuid>9052a337-efb8-4a79-95c1-685d22966cec</uuid>
Aug 27 03:47:26 user nova-compute[72990]:   <name>instance-00000013</name>
Aug 27 03:47:26 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:47:26 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:47:26 user nova-compute[72990]:   <metadata>
Aug 27 03:47:26 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:47:26 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:47:26 user nova-compute[72990]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1844801511</nova:name>
Aug 27 03:47:26 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:47:26</nova:creationTime>
Aug 27 03:47:26 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:47:26 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:47:26 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:47:26 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:47:26 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:47:26 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:47:26 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:47:26 user nova-compute[72990]:       <nova:owner>
Aug 27 03:47:26 user nova-compute[72990]:         <nova:user uuid="4e7d2fc4d4204ad38d0d11376de45bd6">tempest-AttachVolumeNegativeTest-945598863-project-member</nova:user>
Aug 27 03:47:26 user nova-compute[72990]:         <nova:project uuid="d007a65dbbce40729d2d7a25561a4f91">tempest-AttachVolumeNegativeTest-945598863</nova:project>
Aug 27 03:47:26 user nova-compute[72990]:       </nova:owner>
Aug 27 03:47:26 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:47:26 user nova-compute[72990]:       <nova:ports>
Aug 27 03:47:26 user nova-compute[72990]:         <nova:port uuid="ed0518e1-05ee-4dde-b386-b83977c4872c">
Aug 27 03:47:26 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 03:47:26 user nova-compute[72990]:         </nova:port>
Aug 27 03:47:26 user nova-compute[72990]:       </nova:ports>
Aug 27 03:47:26 user nova-compute[72990]:     </nova:instance>
Aug 27 03:47:26 user nova-compute[72990]:   </metadata>
Aug 27 03:47:26 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:47:26 user nova-compute[72990]:     <system>
Aug 27 03:47:26 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:47:26 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:47:26 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:47:26 user nova-compute[72990]:       <entry name="serial">9052a337-efb8-4a79-95c1-685d22966cec</entry>
Aug 27 03:47:26 user nova-compute[72990]:       <entry name="uuid">9052a337-efb8-4a79-95c1-685d22966cec</entry>
Aug 27 03:47:26 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:47:26 user nova-compute[72990]:     </system>
Aug 27 03:47:26 user nova-compute[72990]:   </sysinfo>
Aug 27 03:47:26 user nova-compute[72990]:   <os>
Aug 27 03:47:26 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:47:26 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:47:26 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:47:26 user nova-compute[72990]:   </os>
Aug 27 03:47:26 user nova-compute[72990]:   <features>
Aug 27 03:47:26 user nova-compute[72990]:     <acpi/>
Aug 27 03:47:26 user nova-compute[72990]:     <apic/>
Aug 27 03:47:26 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:47:26 user nova-compute[72990]:   </features>
Aug 27 03:47:26 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:47:26 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:47:26 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:47:26 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:47:26 user nova-compute[72990]:   </clock>
Aug 27 03:47:26 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:47:26 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:47:26 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:47:26 user nova-compute[72990]:   </cpu>
Aug 27 03:47:26 user nova-compute[72990]:   <devices>
Aug 27 03:47:26 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:47:26 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:47:26 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk"/>
Aug 27 03:47:26 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:47:26 user nova-compute[72990]:     </disk>
Aug 27 03:47:26 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:47:26 user nova-compute[72990]:       <mac address="fa:16:3e:c9:9e:a3"/>
Aug 27 03:47:26 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:47:26 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:47:26 user nova-compute[72990]:       <target dev="taped0518e1-05"/>
Aug 27 03:47:26 user nova-compute[72990]:     </interface>
Aug 27 03:47:26 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:47:26 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/console.log" append="off"/>
Aug 27 03:47:26 user nova-compute[72990]:     </serial>
Aug 27 03:47:26 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:47:26 user nova-compute[72990]:     <video>
Aug 27 03:47:26 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:47:26 user nova-compute[72990]:     </video>
Aug 27 03:47:26 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:47:26 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:47:26 user nova-compute[72990]:     </rng>
Aug 27 03:47:26 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:47:26 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:47:26 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:47:26 user nova-compute[72990]:     </memballoon>
Aug 27 03:47:26 user nova-compute[72990]:   </devices>
Aug 27 03:47:26 user nova-compute[72990]: </domain>
Aug 27 03:47:26 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1844801511',display_name='tempest-AttachVolumeNegativeTest-server-1844801511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1844801511',id=19,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtzJe4pwiGtzii4pfCo8neGv61D2bhbkP+CCXV6bq46JzYeYLsAOFCkle3MKvfFwhQ1DdIBsczmoD6qUTsDkAVxj/p9u8fy/qrF5qwOjMvO6z2n6Fa4Sbb7D7VO4TQpaA==',key_name='tempest-keypair-2125464292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d007a65dbbce40729d2d7a25561a4f91',ramdisk_id='',reservation_id='r-vel7i9p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-945598863',owner_user_name='tempest-AttachVolumeNegativeTest-945598863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7d2fc4d4204ad38d0d11376de45bd6',uuid=9052a337-efb8-4a79-95c1-685d22966cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed0518e1-05ee-4dde-b386-b83977c4872c", "address": "fa:16:3e:c9:9e:a3", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0518e1-05", "ovs_interfaceid": "ed0518e1-05ee-4dde-b386-b83977c4872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converting VIF {"id": "ed0518e1-05ee-4dde-b386-b83977c4872c", "address": "fa:16:3e:c9:9e:a3", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0518e1-05", "ovs_interfaceid": "ed0518e1-05ee-4dde-b386-b83977c4872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9e:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed0518e1-05ee-4dde-b386-b83977c4872c,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0518e1-05') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG os_vif [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9e:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed0518e1-05ee-4dde-b386-b83977c4872c,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0518e1-05') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped0518e1-05, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped0518e1-05, col_values=(('external_ids', {'iface-id': 'ed0518e1-05ee-4dde-b386-b83977c4872c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:9e:a3', 'vm-uuid': '9052a337-efb8-4a79-95c1-685d22966cec'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:26 user nova-compute[72990]: INFO os_vif [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9e:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed0518e1-05ee-4dde-b386-b83977c4872c,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0518e1-05')
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No VIF found with MAC fa:16:3e:c9:9e:a3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG nova.network.neutron [req-1814aac1-728f-451d-9507-ea13cf53c52d req-3392eb09-2dfb-435f-a826-3a73d9ab49b5 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Updated VIF entry in instance network info cache for port ed0518e1-05ee-4dde-b386-b83977c4872c. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG nova.network.neutron [req-1814aac1-728f-451d-9507-ea13cf53c52d req-3392eb09-2dfb-435f-a826-3a73d9ab49b5 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Updating instance_info_cache with network_info: [{"id": "ed0518e1-05ee-4dde-b386-b83977c4872c", "address": "fa:16:3e:c9:9e:a3", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0518e1-05", "ovs_interfaceid": "ed0518e1-05ee-4dde-b386-b83977c4872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1814aac1-728f-451d-9507-ea13cf53c52d req-3392eb09-2dfb-435f-a826-3a73d9ab49b5 service nova] Releasing lock "refresh_cache-9052a337-efb8-4a79-95c1-685d22966cec" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-4141ab0d-502a-4e3a-81e3-9fe5d7086d83 req-8c6f1d7b-63c0-4ed5-98ee-9a33ebb1375e service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Received event network-vif-plugged-ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4141ab0d-502a-4e3a-81e3-9fe5d7086d83 req-8c6f1d7b-63c0-4ed5-98ee-9a33ebb1375e service nova] Acquiring lock "9052a337-efb8-4a79-95c1-685d22966cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4141ab0d-502a-4e3a-81e3-9fe5d7086d83 req-8c6f1d7b-63c0-4ed5-98ee-9a33ebb1375e service nova] Lock "9052a337-efb8-4a79-95c1-685d22966cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4141ab0d-502a-4e3a-81e3-9fe5d7086d83 req-8c6f1d7b-63c0-4ed5-98ee-9a33ebb1375e service nova] Lock "9052a337-efb8-4a79-95c1-685d22966cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-4141ab0d-502a-4e3a-81e3-9fe5d7086d83 req-8c6f1d7b-63c0-4ed5-98ee-9a33ebb1375e service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] No waiting events found dispatching network-vif-plugged-ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:28 user nova-compute[72990]: WARNING nova.compute.manager [req-4141ab0d-502a-4e3a-81e3-9fe5d7086d83 req-8c6f1d7b-63c0-4ed5-98ee-9a33ebb1375e service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Received unexpected event network-vif-plugged-ed0518e1-05ee-4dde-b386-b83977c4872c for instance with vm_state building and task_state spawning.
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:47:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:29 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108034.4795496, bc82cced-9f16-44bc-b9bc-622fa99b1be0 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:47:29 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] VM Stopped (Lifecycle Event)
Aug 27 03:47:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-fd3115af-0f1e-40df-80c0-3c9a0577b6ec None None] [instance: bc82cced-9f16-44bc-b9bc-622fa99b1be0] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:47:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:30 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:47:30 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7310MB free_disk=25.243671417236328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ed1742b9-a19d-43f9-b39a-7257261f858c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance f8dc092c-cd9d-417c-9c70-b805d59b6116 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 338682cb-8c70-49c3-b88c-362e96ec8fb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 9052a337-efb8-4a79-95c1-685d22966cec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108050.36157, 9052a337-efb8-4a79-95c1-685d22966cec => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:47:30 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] VM Resumed (Lifecycle Event)
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:47:30 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Instance spawned successfully.
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:47:30 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108050.365205, 9052a337-efb8-4a79-95c1-685d22966cec => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:47:30 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] VM Started (Lifecycle Event)
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:47:30 user nova-compute[72990]: INFO nova.compute.manager [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Took 6.69 seconds to spawn the instance on the hypervisor.
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:47:30 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-d48cd26a-463b-4917-9d3a-e5b51aa0311a req-0116dbcc-1563-4cfe-a260-009611f3b531 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Received event network-vif-plugged-ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d48cd26a-463b-4917-9d3a-e5b51aa0311a req-0116dbcc-1563-4cfe-a260-009611f3b531 service nova] Acquiring lock "9052a337-efb8-4a79-95c1-685d22966cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d48cd26a-463b-4917-9d3a-e5b51aa0311a req-0116dbcc-1563-4cfe-a260-009611f3b531 service nova] Lock "9052a337-efb8-4a79-95c1-685d22966cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d48cd26a-463b-4917-9d3a-e5b51aa0311a req-0116dbcc-1563-4cfe-a260-009611f3b531 service nova] Lock "9052a337-efb8-4a79-95c1-685d22966cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-d48cd26a-463b-4917-9d3a-e5b51aa0311a req-0116dbcc-1563-4cfe-a260-009611f3b531 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] No waiting events found dispatching network-vif-plugged-ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:30 user nova-compute[72990]: WARNING nova.compute.manager [req-d48cd26a-463b-4917-9d3a-e5b51aa0311a req-0116dbcc-1563-4cfe-a260-009611f3b531 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Received unexpected event network-vif-plugged-ed0518e1-05ee-4dde-b386-b83977c4872c for instance with vm_state building and task_state spawning.
Aug 27 03:47:30 user nova-compute[72990]: INFO nova.compute.manager [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Took 7.62 seconds to build instance.
Aug 27 03:47:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-70a49948-4b9b-491f-823a-ea8d8c37071f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "9052a337-efb8-4a79-95c1-685d22966cec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.745s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:47:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:47:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:47:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Didn't find any instances for network info cache update. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 03:47:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:47:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG nova.objects.instance [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lazy-loading 'flavor' on Instance uuid f8dc092c-cd9d-417c-9c70-b805d59b6116 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:41 user nova-compute[72990]: INFO nova.compute.manager [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Attaching volume bc1df04c-435a-49ee-af35-cb2e3604fc3a to /dev/vdb
Aug 27 03:47:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG os_brick.utils [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d1d67e-0d52-4fda-ba4e-557f57d8fd36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[93446a4b-5c37-432d-b9fb-6e1ef8a8290b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[103d6d55-c533-4bd5-aba8-9948959d564d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e531fe-6f0b-455c-8dc3-3230e39f9816]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:47:41 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:47:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4580080-45f6-4af6-82e8-7c5a430f83e9]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG os_brick.utils [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:47:41 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Updating existing volume attachment record: 032bd12f-f6b0-447e-b243-b27ac7dbab60 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:47:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mINxLzih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:47:53 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:47:53 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:47:53 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee0d282-423f-4098-9eaf-db94ce71351a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:47:53 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[05114234-e1a4-49ad-89e9-464e6d8e75b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a] added
Aug 27 03:47:53 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb499d1-3a9a-4c30-8ee4-4eddd3649204]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9a7410-69a4-40ed-8d9b-acc9e81e0112]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mINxLzih {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mINxLzih" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c098e6-9109-46af-9597-3a3e31cdb09d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mINxLzih'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc11470-1d07-4710-92b4-6d5e630e81d8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d453a8b3-720a-4582-9c3b-1ad5f8efda52]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:47:53 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:47:53 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:47:53 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:47:53 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:47:53 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:47:53 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6ee0a1-ca47-471a-ada8-158fe241c6ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a, portal: 172.16.0.220,3260]
Aug 27 03:47:53 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a, portal: 172.16.0.220,3260] successful.
Aug 27 03:47:53 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ab76bd-e297-4e75-8749-ca65e968930f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[611f8aba-53e7-4074-b74b-06b71515ed58]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:47:53 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:47:53 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:47:53 user nova-compute[72990]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a (non-flash)
Aug 27 03:47:53 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:47:53 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:47:53 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:47:53 user nova-compute[72990]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a (non-flash)
Aug 27 03:47:53 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5def75-13ac-413d-8a84-ca13155f2e21]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:53 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:47:54 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:47:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mINxLzih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:47:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:47:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23962313165333139', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:47:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962313165333139', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:47:54 user nova-compute[72990]: DEBUG nova.objects.instance [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lazy-loading 'flavor' on Instance uuid f8dc092c-cd9d-417c-9c70-b805d59b6116 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:47:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:47:54 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:47:54 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:47:54 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:47:54 user nova-compute[72990]:   <serial>bc1df04c-435a-49ee-af35-cb2e3604fc3a</serial>
Aug 27 03:47:54 user nova-compute[72990]: </disk>
Aug 27 03:47:54 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:47:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:47:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:47:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] No VIF found with MAC fa:16:3e:9b:2a:d8, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:47:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-df715de8-3c4f-436c-ac23-3ac84fd12af9 tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.701s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:55 user nova-compute[72990]: INFO nova.compute.manager [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Terminating instance
Aug 27 03:47:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-8a6eaa9a-71bf-4d19-a720-b9ae8dc400a6 req-53929537-2f95-4f9d-97bf-30a950964ee5 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Received event network-vif-unplugged-1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8a6eaa9a-71bf-4d19-a720-b9ae8dc400a6 req-53929537-2f95-4f9d-97bf-30a950964ee5 service nova] Acquiring lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8a6eaa9a-71bf-4d19-a720-b9ae8dc400a6 req-53929537-2f95-4f9d-97bf-30a950964ee5 service nova] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8a6eaa9a-71bf-4d19-a720-b9ae8dc400a6 req-53929537-2f95-4f9d-97bf-30a950964ee5 service nova] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-8a6eaa9a-71bf-4d19-a720-b9ae8dc400a6 req-53929537-2f95-4f9d-97bf-30a950964ee5 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] No waiting events found dispatching network-vif-unplugged-1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-8a6eaa9a-71bf-4d19-a720-b9ae8dc400a6 req-53929537-2f95-4f9d-97bf-30a950964ee5 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Received event network-vif-unplugged-1e76d6dd-c588-401f-9a92-9e0eb13dd67f for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:56 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Instance destroyed successfully.
Aug 27 03:47:56 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lazy-loading 'resources' on Instance uuid f8dc092c-cd9d-417c-9c70-b805d59b6116 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1039141753',display_name='tempest-DeleteServersTestJSON-server-1039141753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1039141753',id=17,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:45:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df9f07b56b414b1aaf819802e3ac4b35',ramdisk_id='',reservation_id='r-jral4024',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1847790794',owner_user_name='tempest-DeleteServersTestJSON-1847790794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:45:54Z,user_data=None,user_id='15d5e522dfdc4522a62502bc5ec9133f',uuid=f8dc092c-cd9d-417c-9c70-b805d59b6116,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "address": "fa:16:3e:9b:2a:d8", "network": {"id": "97d760ce-ff1d-43e2-8854-9b0e9e55af5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1248261596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9f07b56b414b1aaf819802e3ac4b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76d6dd-c5", "ovs_interfaceid": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Converting VIF {"id": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "address": "fa:16:3e:9b:2a:d8", "network": {"id": "97d760ce-ff1d-43e2-8854-9b0e9e55af5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1248261596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9f07b56b414b1aaf819802e3ac4b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e76d6dd-c5", "ovs_interfaceid": "1e76d6dd-c588-401f-9a92-9e0eb13dd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:d8,bridge_name='br-int',has_traffic_filtering=True,id=1e76d6dd-c588-401f-9a92-9e0eb13dd67f,network=Network(97d760ce-ff1d-43e2-8854-9b0e9e55af5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e76d6dd-c5') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG os_vif [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:d8,bridge_name='br-int',has_traffic_filtering=True,id=1e76d6dd-c588-401f-9a92-9e0eb13dd67f,network=Network(97d760ce-ff1d-43e2-8854-9b0e9e55af5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e76d6dd-c5') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e76d6dd-c5, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:47:56 user nova-compute[72990]: INFO os_vif [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:d8,bridge_name='br-int',has_traffic_filtering=True,id=1e76d6dd-c588-401f-9a92-9e0eb13dd67f,network=Network(97d760ce-ff1d-43e2-8854-9b0e9e55af5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e76d6dd-c5')
Aug 27 03:47:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mINxLzih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:47:56 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:47:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5f95ea-c63f-4c1a-af10-cb2a2db4852b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[680da0b1-c457-4f0d-b500-6686936914c3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:47:56 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:47:56 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:47:56 user nova-compute[72990]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a (non-flash)
Aug 27 03:47:56 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:47:56 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:47:56 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:47:56 user nova-compute[72990]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a (non-flash)
Aug 27 03:47:56 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa721551900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4278caf-4533-4ffa-96d2-540dc8eb09a8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6387d9a-6e3b-4ca1-af76-ea064a9d40b7]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b050ec-a9f9-4286-a00f-87183c5794bd]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:47:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6280a017-d18b-45d0-93e8-c7b8f6ae4135]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3e030f-5280-4b33-bf2a-2c775d44a99f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[845488ce-fbed-461e-9e76-79b99ed1bb7e]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a, portal: 172.16.0.220,3260]
Aug 27 03:47:57 user nova-compute[72990]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a, portal: 172.16.0.220,3260] successful.
Aug 27 03:47:57 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1df04c-435a-49ee-af35-cb2e3604fc3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c70794-939d-4c8e-a20a-8d8c4746d7dc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] <== disconnect_volume: return (312ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:47:57 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Deleting instance files /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116_del
Aug 27 03:47:57 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Deletion of /opt/stack/data/nova/instances/f8dc092c-cd9d-417c-9c70-b805d59b6116_del complete
Aug 27 03:47:57 user nova-compute[72990]: INFO nova.compute.manager [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 27 03:47:57 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:47:57 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:47:57 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Took 0.52 seconds to deallocate network for instance.
Aug 27 03:47:58 user nova-compute[72990]: DEBUG nova.compute.manager [req-6b25a643-76d9-4103-9e30-7b9c2979a034 req-d8d5d564-cfcc-4929-ac44-2b88cb3d5c26 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Received event network-vif-plugged-1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6b25a643-76d9-4103-9e30-7b9c2979a034 req-d8d5d564-cfcc-4929-ac44-2b88cb3d5c26 service nova] Acquiring lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6b25a643-76d9-4103-9e30-7b9c2979a034 req-d8d5d564-cfcc-4929-ac44-2b88cb3d5c26 service nova] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6b25a643-76d9-4103-9e30-7b9c2979a034 req-d8d5d564-cfcc-4929-ac44-2b88cb3d5c26 service nova] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:58 user nova-compute[72990]: DEBUG nova.compute.manager [req-6b25a643-76d9-4103-9e30-7b9c2979a034 req-d8d5d564-cfcc-4929-ac44-2b88cb3d5c26 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] No waiting events found dispatching network-vif-plugged-1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:47:58 user nova-compute[72990]: WARNING nova.compute.manager [req-6b25a643-76d9-4103-9e30-7b9c2979a034 req-d8d5d564-cfcc-4929-ac44-2b88cb3d5c26 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Received unexpected event network-vif-plugged-1e76d6dd-c588-401f-9a92-9e0eb13dd67f for instance with vm_state active and task_state deleting.
Aug 27 03:47:58 user nova-compute[72990]: DEBUG nova.compute.manager [req-6b25a643-76d9-4103-9e30-7b9c2979a034 req-d8d5d564-cfcc-4929-ac44-2b88cb3d5c26 service nova] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Received event network-vif-deleted-1e76d6dd-c588-401f-9a92-9e0eb13dd67f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:47:58 user nova-compute[72990]: INFO nova.compute.manager [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Took 0.75 seconds to detach 1 volumes for instance.
Aug 27 03:47:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:47:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:47:58 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:47:58 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:47:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:47:58 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Deleted allocations for instance f8dc092c-cd9d-417c-9c70-b805d59b6116
Aug 27 03:47:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2af6c512-5ac4-4029-b249-8389e847e6ba tempest-DeleteServersTestJSON-1847790794 tempest-DeleteServersTestJSON-1847790794-project-member] Lock "f8dc092c-cd9d-417c-9c70-b805d59b6116" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.045s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:11 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108076.7921765, f8dc092c-cd9d-417c-9c70-b805d59b6116 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:48:11 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] VM Stopped (Lifecycle Event)
Aug 27 03:48:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-140c5623-a2bc-47c0-932a-41cdc7ac3169 None None] [instance: f8dc092c-cd9d-417c-9c70-b805d59b6116] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:48:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-57477d9c-50ff-402d-be3b-c34f06865416 req-cc702af0-a7b6-419d-93fa-1c7fcc212a85 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-changed-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:48:16 user nova-compute[72990]: DEBUG nova.compute.manager [req-57477d9c-50ff-402d-be3b-c34f06865416 req-cc702af0-a7b6-419d-93fa-1c7fcc212a85 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Refreshing instance network info cache due to event network-changed-09f159e5-8c35-4fa2-a2e9-873634e6a084. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:48:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-57477d9c-50ff-402d-be3b-c34f06865416 req-cc702af0-a7b6-419d-93fa-1c7fcc212a85 service nova] Acquiring lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:48:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-57477d9c-50ff-402d-be3b-c34f06865416 req-cc702af0-a7b6-419d-93fa-1c7fcc212a85 service nova] Acquired lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:48:16 user nova-compute[72990]: DEBUG nova.network.neutron [req-57477d9c-50ff-402d-be3b-c34f06865416 req-cc702af0-a7b6-419d-93fa-1c7fcc212a85 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Refreshing network info cache for port 09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:48:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:18 user nova-compute[72990]: DEBUG nova.network.neutron [req-57477d9c-50ff-402d-be3b-c34f06865416 req-cc702af0-a7b6-419d-93fa-1c7fcc212a85 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updated VIF entry in instance network info cache for port 09f159e5-8c35-4fa2-a2e9-873634e6a084. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:48:18 user nova-compute[72990]: DEBUG nova.network.neutron [req-57477d9c-50ff-402d-be3b-c34f06865416 req-cc702af0-a7b6-419d-93fa-1c7fcc212a85 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating instance_info_cache with network_info: [{"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:48:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-57477d9c-50ff-402d-be3b-c34f06865416 req-cc702af0-a7b6-419d-93fa-1c7fcc212a85 service nova] Releasing lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:48:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:20 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:48:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:23 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:48:23 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:48:23 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:48:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:48:25 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:48:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:26 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:48:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:48:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:27 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:48:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.004s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:30 user nova-compute[72990]: INFO nova.compute.manager [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Unshelving
Aug 27 03:48:30 user nova-compute[72990]: INFO nova.virt.block_device [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Booting with volume 43bb8c4c-9749-468d-8371-1d1818fa1f66 at /dev/vdc
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG os_brick.utils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc54d04-154c-4a45-8cc1-8031fac27cf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d155d5d5-183c-40dc-92bf-2eefe1124723]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[697cf98e-cb41-4a96-a587-c18a38acb757]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf696d65-c971-4ce4-ba2e-d5959bb62266]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:48:30 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[44340a22-5b3b-4ff5-b806-13b96363baed]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG os_brick.utils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updating existing volume attachment record: 669bb376-c930-44ee-bebc-9eeb3ca25c5b {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:48:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:32 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:48:32 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7617MB free_disk=25.238819122314453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ed1742b9-a19d-43f9-b39a-7257261f858c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 338682cb-8c70-49c3-b88c-362e96ec8fb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 9052a337-efb8-4a79-95c1-685d22966cec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 1e81de88-259e-4124-8e2c-cafd310a9b42 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:48:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:33 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:48:33 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:48:33 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:48:33 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 03:48:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:48:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:48:33 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:48:33 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:48:34 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Updating instance_info_cache with network_info: [{"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:48:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:48:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:48:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:48:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:48:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:48:38 user nova-compute[72990]: INFO nova.compute.claims [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Claim successful on node user
Aug 27 03:48:39 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:48:39 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:48:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG nova.policy [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2908a9f30c314839abec26c49028f756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9300e35c8184397bcb840a58209d97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:48:39 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Creating image(s)
Aug 27 03:48:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.209s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk 1073741824" returned: 0 in 0.061s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Cannot resize image /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Ensure instance console log exists: /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:40 user nova-compute[72990]: DEBUG nova.network.neutron [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Successfully created port: 84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Successfully updated port: 84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquired lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-597145c6-efc4-480a-937a-278dd63e48e9 req-2de57163-4fb5-4c80-99ab-b718c6b90f33 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-changed-84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-597145c6-efc4-480a-937a-278dd63e48e9 req-2de57163-4fb5-4c80-99ab-b718c6b90f33 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Refreshing instance network info cache due to event network-changed-84ceee62-cd25-4a7f-b1e5-4e327e56d019. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-597145c6-efc4-480a-937a-278dd63e48e9 req-2de57163-4fb5-4c80-99ab-b718c6b90f33 service nova] Acquiring lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updating instance_info_cache with network_info: [{"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Releasing lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Instance network_info: |[{"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-597145c6-efc4-480a-937a-278dd63e48e9 req-2de57163-4fb5-4c80-99ab-b718c6b90f33 service nova] Acquired lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.network.neutron [req-597145c6-efc4-480a-937a-278dd63e48e9 req-2de57163-4fb5-4c80-99ab-b718c6b90f33 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Refreshing network info cache for port 84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Start _get_guest_xml network_info=[{"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:48:41 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:48:41 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:48:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-212175205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-212175205',id=20,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp5iBc6mdgWaggg8GPI462w6II2N5RXXCb7cdBNB2ye3sojol5LvoVHu+BZkBNjSsdZnceTMdoaxLj46rXSeiRp/G2O9qGXI+h1ydtY+K0cIAqh7rlTCqTWWaEgArwZNw==',key_name='tempest-keypair-1954013112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9300e35c8184397bcb840a58209d97c',ramdisk_id='',reservation_id='r-w1471yyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2065968082',owner_user_name='tempest-TaggedAttachmentsTest-2065968082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2908a9f30c314839abec26c49028f756',uuid=f2c7f4ed-0c08-4bd8-8386-3830b33a2564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converting VIF {"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:20:06,bridge_name='br-int',has_traffic_filtering=True,id=84ceee62-cd25-4a7f-b1e5-4e327e56d019,network=Network(5e2456d4-127a-4834-af38-871e86b1f296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ceee62-cd') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.objects.instance [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lazy-loading 'pci_devices' on Instance uuid f2c7f4ed-0c08-4bd8-8386-3830b33a2564 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:48:42 user nova-compute[72990]:   <uuid>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</uuid>
Aug 27 03:48:42 user nova-compute[72990]:   <name>instance-00000014</name>
Aug 27 03:48:42 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:48:42 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:48:42 user nova-compute[72990]:   <metadata>
Aug 27 03:48:42 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:48:42 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:48:42 user nova-compute[72990]:       <nova:name>tempest-device-tagging-server-212175205</nova:name>
Aug 27 03:48:42 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:48:41</nova:creationTime>
Aug 27 03:48:42 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:48:42 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:48:42 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:48:42 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:48:42 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:48:42 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:48:42 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:48:42 user nova-compute[72990]:       <nova:owner>
Aug 27 03:48:42 user nova-compute[72990]:         <nova:user uuid="2908a9f30c314839abec26c49028f756">tempest-TaggedAttachmentsTest-2065968082-project-member</nova:user>
Aug 27 03:48:42 user nova-compute[72990]:         <nova:project uuid="f9300e35c8184397bcb840a58209d97c">tempest-TaggedAttachmentsTest-2065968082</nova:project>
Aug 27 03:48:42 user nova-compute[72990]:       </nova:owner>
Aug 27 03:48:42 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:48:42 user nova-compute[72990]:       <nova:ports>
Aug 27 03:48:42 user nova-compute[72990]:         <nova:port uuid="84ceee62-cd25-4a7f-b1e5-4e327e56d019">
Aug 27 03:48:42 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 03:48:42 user nova-compute[72990]:         </nova:port>
Aug 27 03:48:42 user nova-compute[72990]:       </nova:ports>
Aug 27 03:48:42 user nova-compute[72990]:     </nova:instance>
Aug 27 03:48:42 user nova-compute[72990]:   </metadata>
Aug 27 03:48:42 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:48:42 user nova-compute[72990]:     <system>
Aug 27 03:48:42 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:48:42 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:48:42 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:48:42 user nova-compute[72990]:       <entry name="serial">f2c7f4ed-0c08-4bd8-8386-3830b33a2564</entry>
Aug 27 03:48:42 user nova-compute[72990]:       <entry name="uuid">f2c7f4ed-0c08-4bd8-8386-3830b33a2564</entry>
Aug 27 03:48:42 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:48:42 user nova-compute[72990]:     </system>
Aug 27 03:48:42 user nova-compute[72990]:   </sysinfo>
Aug 27 03:48:42 user nova-compute[72990]:   <os>
Aug 27 03:48:42 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:48:42 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:48:42 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:48:42 user nova-compute[72990]:   </os>
Aug 27 03:48:42 user nova-compute[72990]:   <features>
Aug 27 03:48:42 user nova-compute[72990]:     <acpi/>
Aug 27 03:48:42 user nova-compute[72990]:     <apic/>
Aug 27 03:48:42 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:48:42 user nova-compute[72990]:   </features>
Aug 27 03:48:42 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:48:42 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:48:42 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:48:42 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:48:42 user nova-compute[72990]:   </clock>
Aug 27 03:48:42 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:48:42 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:48:42 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:48:42 user nova-compute[72990]:   </cpu>
Aug 27 03:48:42 user nova-compute[72990]:   <devices>
Aug 27 03:48:42 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:48:42 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:48:42 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk"/>
Aug 27 03:48:42 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:48:42 user nova-compute[72990]:     </disk>
Aug 27 03:48:42 user nova-compute[72990]:     <disk type="file" device="cdrom">
Aug 27 03:48:42 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 03:48:42 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk.config"/>
Aug 27 03:48:42 user nova-compute[72990]:       <target dev="hda" bus="ide"/>
Aug 27 03:48:42 user nova-compute[72990]:     </disk>
Aug 27 03:48:42 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:48:42 user nova-compute[72990]:       <mac address="fa:16:3e:ef:20:06"/>
Aug 27 03:48:42 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:48:42 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:48:42 user nova-compute[72990]:       <target dev="tap84ceee62-cd"/>
Aug 27 03:48:42 user nova-compute[72990]:     </interface>
Aug 27 03:48:42 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:48:42 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/console.log" append="off"/>
Aug 27 03:48:42 user nova-compute[72990]:     </serial>
Aug 27 03:48:42 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:48:42 user nova-compute[72990]:     <video>
Aug 27 03:48:42 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:48:42 user nova-compute[72990]:     </video>
Aug 27 03:48:42 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:48:42 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:48:42 user nova-compute[72990]:     </rng>
Aug 27 03:48:42 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:48:42 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:48:42 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:48:42 user nova-compute[72990]:     </memballoon>
Aug 27 03:48:42 user nova-compute[72990]:   </devices>
Aug 27 03:48:42 user nova-compute[72990]: </domain>
Aug 27 03:48:42 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-212175205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-212175205',id=20,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp5iBc6mdgWaggg8GPI462w6II2N5RXXCb7cdBNB2ye3sojol5LvoVHu+BZkBNjSsdZnceTMdoaxLj46rXSeiRp/G2O9qGXI+h1ydtY+K0cIAqh7rlTCqTWWaEgArwZNw==',key_name='tempest-keypair-1954013112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9300e35c8184397bcb840a58209d97c',ramdisk_id='',reservation_id='r-w1471yyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2065968082',owner_user_name='tempest-TaggedAttachmentsTest-2065968082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2908a9f30c314839abec26c49028f756',uuid=f2c7f4ed-0c08-4bd8-8386-3830b33a2564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converting VIF {"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:20:06,bridge_name='br-int',has_traffic_filtering=True,id=84ceee62-cd25-4a7f-b1e5-4e327e56d019,network=Network(5e2456d4-127a-4834-af38-871e86b1f296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ceee62-cd') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG os_vif [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:20:06,bridge_name='br-int',has_traffic_filtering=True,id=84ceee62-cd25-4a7f-b1e5-4e327e56d019,network=Network(5e2456d4-127a-4834-af38-871e86b1f296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ceee62-cd') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84ceee62-cd, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84ceee62-cd, col_values=(('external_ids', {'iface-id': '84ceee62-cd25-4a7f-b1e5-4e327e56d019', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:20:06', 'vm-uuid': 'f2c7f4ed-0c08-4bd8-8386-3830b33a2564'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:42 user nova-compute[72990]: INFO os_vif [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:20:06,bridge_name='br-int',has_traffic_filtering=True,id=84ceee62-cd25-4a7f-b1e5-4e327e56d019,network=Network(5e2456d4-127a-4834-af38-871e86b1f296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ceee62-cd')
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] No BDM found with device name hda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] No VIF found with MAC fa:16:3e:ef:20:06, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:48:42 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Using config drive
Aug 27 03:48:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:42 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Creating config drive at /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk.config
Aug 27 03:48:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkwemugh2 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkwemugh2" returned: 0 in 0.056s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.network.neutron [req-597145c6-efc4-480a-937a-278dd63e48e9 req-2de57163-4fb5-4c80-99ab-b718c6b90f33 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updated VIF entry in instance network info cache for port 84ceee62-cd25-4a7f-b1e5-4e327e56d019. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG nova.network.neutron [req-597145c6-efc4-480a-937a-278dd63e48e9 req-2de57163-4fb5-4c80-99ab-b718c6b90f33 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updating instance_info_cache with network_info: [{"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:48:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-597145c6-efc4-480a-937a-278dd63e48e9 req-2de57163-4fb5-4c80-99ab-b718c6b90f33 service nova] Releasing lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:48:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:43 user nova-compute[72990]: DEBUG nova.objects.instance [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'pci_requests' on Instance uuid 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:48:43 user nova-compute[72990]: DEBUG nova.objects.instance [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:48:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:48:43 user nova-compute[72990]: INFO nova.compute.claims [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Claim successful on node user
Aug 27 03:48:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:43 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:48:43 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-65461466-c116-417c-a054-9a51288c7d4f req-60cfa6f4-2537-4575-ae6a-cd2ecc9ac72c service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-vif-plugged-84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-65461466-c116-417c-a054-9a51288c7d4f req-60cfa6f4-2537-4575-ae6a-cd2ecc9ac72c service nova] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-65461466-c116-417c-a054-9a51288c7d4f req-60cfa6f4-2537-4575-ae6a-cd2ecc9ac72c service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-65461466-c116-417c-a054-9a51288c7d4f req-60cfa6f4-2537-4575-ae6a-cd2ecc9ac72c service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-65461466-c116-417c-a054-9a51288c7d4f req-60cfa6f4-2537-4575-ae6a-cd2ecc9ac72c service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] No waiting events found dispatching network-vif-plugged-84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:48:44 user nova-compute[72990]: WARNING nova.compute.manager [req-65461466-c116-417c-a054-9a51288c7d4f req-60cfa6f4-2537-4575-ae6a-cd2ecc9ac72c service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received unexpected event network-vif-plugged-84ceee62-cd25-4a7f-b1e5-4e327e56d019 for instance with vm_state building and task_state spawning.
Aug 27 03:48:44 user nova-compute[72990]: INFO nova.network.neutron [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updating port f875fdb9-c314-4ded-9793-cb49e10bbdd8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquired lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG nova.network.neutron [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-d894ed65-72ce-499a-b2c2-95f2e386f60c req-3978153b-8120-4cfa-a0dd-a151c388ed65 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-changed-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-d894ed65-72ce-499a-b2c2-95f2e386f60c req-3978153b-8120-4cfa-a0dd-a151c388ed65 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Refreshing instance network info cache due to event network-changed-f875fdb9-c314-4ded-9793-cb49e10bbdd8. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:48:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d894ed65-72ce-499a-b2c2-95f2e386f60c req-3978153b-8120-4cfa-a0dd-a151c388ed65 service nova] Acquiring lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:48:45 user nova-compute[72990]: DEBUG nova.network.neutron [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updating instance_info_cache with network_info: [{"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:48:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Releasing lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:48:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:48:45 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Creating image(s)
Aug 27 03:48:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "/opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "/opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:45 user nova-compute[72990]: DEBUG nova.objects.instance [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:48:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d894ed65-72ce-499a-b2c2-95f2e386f60c req-3978153b-8120-4cfa-a0dd-a151c388ed65 service nova] Acquired lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:48:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-d894ed65-72ce-499a-b2c2-95f2e386f60c req-3978153b-8120-4cfa-a0dd-a151c388ed65 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Refreshing network info cache for port f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:48:45 user nova-compute[72990]: DEBUG nova.objects.base [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Object Instance<1e81de88-259e-4124-8e2c-cafd310a9b42> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:48:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "2c9667cbd6cb029da93975572646bd36730f2d9a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "2c9667cbd6cb029da93975572646bd36730f2d9a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a.part --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108125.9073932, f2c7f4ed-0c08-4bd8-8386-3830b33a2564 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:48:46 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] VM Resumed (Lifecycle Event)
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-5d2e6537-7e6d-4500-a79a-c896e07333db req-0fd01182-2793-4f96-841e-3e17b52a58c3 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-vif-plugged-84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5d2e6537-7e6d-4500-a79a-c896e07333db req-0fd01182-2793-4f96-841e-3e17b52a58c3 service nova] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5d2e6537-7e6d-4500-a79a-c896e07333db req-0fd01182-2793-4f96-841e-3e17b52a58c3 service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5d2e6537-7e6d-4500-a79a-c896e07333db req-0fd01182-2793-4f96-841e-3e17b52a58c3 service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-5d2e6537-7e6d-4500-a79a-c896e07333db req-0fd01182-2793-4f96-841e-3e17b52a58c3 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] No waiting events found dispatching network-vif-plugged-84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:48:46 user nova-compute[72990]: WARNING nova.compute.manager [req-5d2e6537-7e6d-4500-a79a-c896e07333db req-0fd01182-2793-4f96-841e-3e17b52a58c3 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received unexpected event network-vif-plugged-84ceee62-cd25-4a7f-b1e5-4e327e56d019 for instance with vm_state building and task_state spawning.
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:48:46 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Instance spawned successfully.
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:48:46 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108125.9084606, f2c7f4ed-0c08-4bd8-8386-3830b33a2564 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:48:46 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] VM Started (Lifecycle Event)
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:48:46 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:48:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a.part --force-share --output=json" returned: 0 in 0.224s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.virt.images [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] 02ba5bab-59e1-43c3-bcd1-ee5ac0dea1ac was qcow2, converting to raw {{(pid=72990) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:48:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a.part /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a.converted {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:46 user nova-compute[72990]: INFO nova.compute.manager [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Took 7.36 seconds to spawn the instance on the hypervisor.
Aug 27 03:48:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG nova.network.neutron [req-d894ed65-72ce-499a-b2c2-95f2e386f60c req-3978153b-8120-4cfa-a0dd-a151c388ed65 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updated VIF entry in instance network info cache for port f875fdb9-c314-4ded-9793-cb49e10bbdd8. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG nova.network.neutron [req-d894ed65-72ce-499a-b2c2-95f2e386f60c req-3978153b-8120-4cfa-a0dd-a151c388ed65 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updating instance_info_cache with network_info: [{"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:48:47 user nova-compute[72990]: INFO nova.compute.manager [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Took 8.32 seconds to build instance.
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d894ed65-72ce-499a-b2c2-95f2e386f60c req-3978153b-8120-4cfa-a0dd-a151c388ed65 service nova] Releasing lock "refresh_cache-1e81de88-259e-4124-8e2c-cafd310a9b42" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cac8636f-bc86-4d39-a324-9d269622beff tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.428s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a.part /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a.converted" returned: 0 in 0.423s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a.converted --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "2c9667cbd6cb029da93975572646bd36730f2d9a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.930s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "2c9667cbd6cb029da93975572646bd36730f2d9a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "2c9667cbd6cb029da93975572646bd36730f2d9a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a,backing_fmt=raw /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a,backing_fmt=raw /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk 1073741824" returned: 0 in 0.058s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "2c9667cbd6cb029da93975572646bd36730f2d9a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:48 user nova-compute[72990]: DEBUG nova.objects.instance [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'migration_context' on Instance uuid 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:48:48 user nova-compute[72990]: DEBUG nova.objects.base [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Object Instance<1e81de88-259e-4124-8e2c-cafd310a9b42> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:48:48 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Rebasing disk image.
Aug 27 03:48:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 -F raw /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 -F raw /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk" returned: 0 in 2.495s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Ensure instance console log exists: /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Start _get_guest_xml network_info=[{"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='88d893331aa99d2bf4f36f11e92b7942',container_format='bare',created_at=2023-08-27T03:46:37Z,direct_url=<?>,disk_format='qcow2',id=02ba5bab-59e1-43c3-bcd1-ee5ac0dea1ac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-540718096-shelved',owner='bd44d92dded643eb89d955dbf6b4d1e3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T03:46:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '669bb376-c930-44ee-bebc-9eeb3ca25c5b', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZbLnxdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '1e81de88-259e-4124-8e2c-cafd310a9b42', 'attached_at': '', 'detached_at': '', 'volume_id': '43bb8c4c-9749-468d-8371-1d1818fa1f66', 'serial': '43bb8c4c-9749-468d-8371-1d1818fa1f66'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:48:50 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:48:50 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='88d893331aa99d2bf4f36f11e92b7942',container_format='bare',created_at=2023-08-27T03:46:37Z,direct_url=<?>,disk_format='qcow2',id=02ba5bab-59e1-43c3-bcd1-ee5ac0dea1ac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-540718096-shelved',owner='bd44d92dded643eb89d955dbf6b4d1e3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T03:46:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.objects.instance [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.objects.base [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Object Instance<1e81de88-259e-4124-8e2c-cafd310a9b42> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZbLnxdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:48:50 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:48:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:48:50 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:48:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:48:50 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:48:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f4983b-5db4-4c8b-9141-d5b0ef58d420]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:48:50 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:48:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c92abe0-860d-4989-a603-8879066d6b30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66] added
Aug 27 03:48:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c923775-5928-4074-9a75-bbcd2a48cdb4]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[184c61eb-96ad-4d26-9d77-34a4b1ec3d75]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MZbLnxdt {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MZbLnxdt" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9987f5d6-5390-4ab6-8b2c-1121b66ada43]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MZbLnxdt'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f923d5cb-ed40-4393-b2e7-7318ce765b9a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a1ce00-b4bb-42c8-a2e0-b102ccb648ec]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:48:51 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:48:51 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:48:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:48:51 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:48:51 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:48:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e202b10-59b3-4a2c-8a59-e89629a32cd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66, portal: 172.16.0.220,3260]
Aug 27 03:48:51 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66, portal: 172.16.0.220,3260] successful.
Aug 27 03:48:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a29db36-7856-4a4f-ace8-44b71b0ac318]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b05ea7d-2fc3-4602-b932-9fd4cc307c41]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:48:51 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:48:51 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:48:51 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:48:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:48:51 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:48:51 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:48:51 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:48:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df77d76-ee4b-4f4d-97d7-12cb8ee534ff]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:48:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZbLnxdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26630393738393665', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630393738393665', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:44:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-540718096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-540718096',id=16,image_ref='02ba5bab-59e1-43c3-bcd1-ee5ac0dea1ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1260377371',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:44:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bd44d92dded643eb89d955dbf6b4d1e3',ramdisk_id='',reservation_id='r-s07xb5he',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2085503517',owner_user_name='tempest-AttachVolumeShelveTestJSON-2085503517-project-member',shelved_at='2023-08-27T03:46:42.042759',shelved_host='user',shelved_image_id='02ba5bab-59e1-43c3-bcd1-ee5ac0dea1ac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:48:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be8e872f1de4248a557155ff1c4f5ec',uuid=1e81de88-259e-4124-8e2c-cafd310a9b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converting VIF {"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.objects.instance [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.objects.base [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Object Instance<1e81de88-259e-4124-8e2c-cafd310a9b42> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:48:52 user nova-compute[72990]:   <uuid>1e81de88-259e-4124-8e2c-cafd310a9b42</uuid>
Aug 27 03:48:52 user nova-compute[72990]:   <name>instance-00000010</name>
Aug 27 03:48:52 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:48:52 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:48:52 user nova-compute[72990]:   <metadata>
Aug 27 03:48:52 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:48:52 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:48:52 user nova-compute[72990]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-540718096</nova:name>
Aug 27 03:48:52 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:48:50</nova:creationTime>
Aug 27 03:48:52 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:48:52 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:48:52 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:48:52 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:48:52 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:48:52 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:48:52 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:48:52 user nova-compute[72990]:       <nova:owner>
Aug 27 03:48:52 user nova-compute[72990]:         <nova:user uuid="0be8e872f1de4248a557155ff1c4f5ec">tempest-AttachVolumeShelveTestJSON-2085503517-project-member</nova:user>
Aug 27 03:48:52 user nova-compute[72990]:         <nova:project uuid="bd44d92dded643eb89d955dbf6b4d1e3">tempest-AttachVolumeShelveTestJSON-2085503517</nova:project>
Aug 27 03:48:52 user nova-compute[72990]:       </nova:owner>
Aug 27 03:48:52 user nova-compute[72990]:       <nova:root type="image" uuid="02ba5bab-59e1-43c3-bcd1-ee5ac0dea1ac"/>
Aug 27 03:48:52 user nova-compute[72990]:       <nova:ports>
Aug 27 03:48:52 user nova-compute[72990]:         <nova:port uuid="f875fdb9-c314-4ded-9793-cb49e10bbdd8">
Aug 27 03:48:52 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 03:48:52 user nova-compute[72990]:         </nova:port>
Aug 27 03:48:52 user nova-compute[72990]:       </nova:ports>
Aug 27 03:48:52 user nova-compute[72990]:     </nova:instance>
Aug 27 03:48:52 user nova-compute[72990]:   </metadata>
Aug 27 03:48:52 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:48:52 user nova-compute[72990]:     <system>
Aug 27 03:48:52 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:48:52 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:48:52 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:48:52 user nova-compute[72990]:       <entry name="serial">1e81de88-259e-4124-8e2c-cafd310a9b42</entry>
Aug 27 03:48:52 user nova-compute[72990]:       <entry name="uuid">1e81de88-259e-4124-8e2c-cafd310a9b42</entry>
Aug 27 03:48:52 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:48:52 user nova-compute[72990]:     </system>
Aug 27 03:48:52 user nova-compute[72990]:   </sysinfo>
Aug 27 03:48:52 user nova-compute[72990]:   <os>
Aug 27 03:48:52 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:48:52 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:48:52 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:48:52 user nova-compute[72990]:   </os>
Aug 27 03:48:52 user nova-compute[72990]:   <features>
Aug 27 03:48:52 user nova-compute[72990]:     <acpi/>
Aug 27 03:48:52 user nova-compute[72990]:     <apic/>
Aug 27 03:48:52 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:48:52 user nova-compute[72990]:   </features>
Aug 27 03:48:52 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:48:52 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:48:52 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:48:52 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:48:52 user nova-compute[72990]:   </clock>
Aug 27 03:48:52 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:48:52 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:48:52 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:48:52 user nova-compute[72990]:   </cpu>
Aug 27 03:48:52 user nova-compute[72990]:   <devices>
Aug 27 03:48:52 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:48:52 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:48:52 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk"/>
Aug 27 03:48:52 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:48:52 user nova-compute[72990]:     </disk>
Aug 27 03:48:52 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:48:52 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:48:52 user nova-compute[72990]:       <source dev="/dev/sdb"/>
Aug 27 03:48:52 user nova-compute[72990]:       <target dev="vdc" bus="virtio"/>
Aug 27 03:48:52 user nova-compute[72990]:       <serial>43bb8c4c-9749-468d-8371-1d1818fa1f66</serial>
Aug 27 03:48:52 user nova-compute[72990]:     </disk>
Aug 27 03:48:52 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:48:52 user nova-compute[72990]:       <mac address="fa:16:3e:e1:25:a5"/>
Aug 27 03:48:52 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:48:52 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:48:52 user nova-compute[72990]:       <target dev="tapf875fdb9-c3"/>
Aug 27 03:48:52 user nova-compute[72990]:     </interface>
Aug 27 03:48:52 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:48:52 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/console.log" append="off"/>
Aug 27 03:48:52 user nova-compute[72990]:     </serial>
Aug 27 03:48:52 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:48:52 user nova-compute[72990]:     <video>
Aug 27 03:48:52 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:48:52 user nova-compute[72990]:     </video>
Aug 27 03:48:52 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:48:52 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:48:52 user nova-compute[72990]:     </rng>
Aug 27 03:48:52 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:48:52 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:48:52 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:48:52 user nova-compute[72990]:     </memballoon>
Aug 27 03:48:52 user nova-compute[72990]:   </devices>
Aug 27 03:48:52 user nova-compute[72990]: </domain>
Aug 27 03:48:52 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:44:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-540718096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-540718096',id=16,image_ref='02ba5bab-59e1-43c3-bcd1-ee5ac0dea1ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1260377371',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:44:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bd44d92dded643eb89d955dbf6b4d1e3',ramdisk_id='',reservation_id='r-s07xb5he',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2085503517',owner_user_name='tempest-AttachVolumeShelveTestJSON-2085503517-project-member',shelved_at='2023-08-27T03:46:42.042759',shelved_host='user',shelved_image_id='02ba5bab-59e1-43c3-bcd1-ee5ac0dea1ac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:48:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be8e872f1de4248a557155ff1c4f5ec',uuid=1e81de88-259e-4124-8e2c-cafd310a9b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converting VIF {"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG os_vif [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf875fdb9-c3, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf875fdb9-c3, col_values=(('external_ids', {'iface-id': 'f875fdb9-c314-4ded-9793-cb49e10bbdd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:25:a5', 'vm-uuid': '1e81de88-259e-4124-8e2c-cafd310a9b42'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:52 user nova-compute[72990]: INFO os_vif [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3')
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:48:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] No VIF found with MAC fa:16:3e:e1:25:a5, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:48:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-2b8910d7-d47c-42e4-84fc-e7663db003d7 req-679fd7c0-f425-43ef-9877-1bdccfbb2962 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:48:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2b8910d7-d47c-42e4-84fc-e7663db003d7 req-679fd7c0-f425-43ef-9877-1bdccfbb2962 service nova] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2b8910d7-d47c-42e4-84fc-e7663db003d7 req-679fd7c0-f425-43ef-9877-1bdccfbb2962 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2b8910d7-d47c-42e4-84fc-e7663db003d7 req-679fd7c0-f425-43ef-9877-1bdccfbb2962 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-2b8910d7-d47c-42e4-84fc-e7663db003d7 req-679fd7c0-f425-43ef-9877-1bdccfbb2962 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] No waiting events found dispatching network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:48:54 user nova-compute[72990]: WARNING nova.compute.manager [req-2b8910d7-d47c-42e4-84fc-e7663db003d7 req-679fd7c0-f425-43ef-9877-1bdccfbb2962 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received unexpected event network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 03:48:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:56 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108136.2092292, 1e81de88-259e-4124-8e2c-cafd310a9b42 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:48:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] VM Resumed (Lifecycle Event)
Aug 27 03:48:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:48:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:48:56 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Instance spawned successfully.
Aug 27 03:48:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:48:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:48:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-e742f9c8-a83e-44ba-bb21-c4c5bb43692c req-0517cee4-822e-4553-bef7-24350185dd5f service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:48:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e742f9c8-a83e-44ba-bb21-c4c5bb43692c req-0517cee4-822e-4553-bef7-24350185dd5f service nova] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e742f9c8-a83e-44ba-bb21-c4c5bb43692c req-0517cee4-822e-4553-bef7-24350185dd5f service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e742f9c8-a83e-44ba-bb21-c4c5bb43692c req-0517cee4-822e-4553-bef7-24350185dd5f service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-e742f9c8-a83e-44ba-bb21-c4c5bb43692c req-0517cee4-822e-4553-bef7-24350185dd5f service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] No waiting events found dispatching network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:48:56 user nova-compute[72990]: WARNING nova.compute.manager [req-e742f9c8-a83e-44ba-bb21-c4c5bb43692c req-0517cee4-822e-4553-bef7-24350185dd5f service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received unexpected event network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 03:48:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:48:56 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108136.2106464, 1e81de88-259e-4124-8e2c-cafd310a9b42 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:48:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] VM Started (Lifecycle Event)
Aug 27 03:48:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:48:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:48:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:48:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:48:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-35816800-36a8-4f52-8df2-c0410d9a92cb tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.328s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "6a44010b-9a96-4343-a35c-1f212d21e47b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:48:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:57 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:48:57 user nova-compute[72990]: INFO nova.compute.claims [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Claim successful on node user
Aug 27 03:48:58 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.753s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG nova.network.neutron [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:48:58 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:48:58 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG nova.policy [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '858a63e8d5964f38ad776985cfbe9121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183297ba5b6549fdb39f2135d92b3794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:48:58 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Creating image(s)
Aug 27 03:48:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "/opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "/opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.216s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.220s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk 1073741824" returned: 0 in 0.056s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG nova.network.neutron [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Successfully created port: d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.200s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Cannot resize image /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Ensure instance console log exists: /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:48:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:00 user nova-compute[72990]: DEBUG nova.network.neutron [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Successfully updated port: d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:49:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "refresh_cache-6a44010b-9a96-4343-a35c-1f212d21e47b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:49:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquired lock "refresh_cache-6a44010b-9a96-4343-a35c-1f212d21e47b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:49:00 user nova-compute[72990]: DEBUG nova.network.neutron [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:49:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-c3866658-03bb-4e60-bf30-695d3057e69d req-cc18926d-c82c-4703-b60f-9dd282cd96c7 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Received event network-changed-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:49:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-c3866658-03bb-4e60-bf30-695d3057e69d req-cc18926d-c82c-4703-b60f-9dd282cd96c7 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Refreshing instance network info cache due to event network-changed-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:49:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c3866658-03bb-4e60-bf30-695d3057e69d req-cc18926d-c82c-4703-b60f-9dd282cd96c7 service nova] Acquiring lock "refresh_cache-6a44010b-9a96-4343-a35c-1f212d21e47b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:49:00 user nova-compute[72990]: DEBUG nova.network.neutron [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:49:00 user nova-compute[72990]: DEBUG nova.network.neutron [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Updating instance_info_cache with network_info: [{"id": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "address": "fa:16:3e:06:ff:f9", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9650c4a-cc", "ovs_interfaceid": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Releasing lock "refresh_cache-6a44010b-9a96-4343-a35c-1f212d21e47b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Instance network_info: |[{"id": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "address": "fa:16:3e:06:ff:f9", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9650c4a-cc", "ovs_interfaceid": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c3866658-03bb-4e60-bf30-695d3057e69d req-cc18926d-c82c-4703-b60f-9dd282cd96c7 service nova] Acquired lock "refresh_cache-6a44010b-9a96-4343-a35c-1f212d21e47b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.network.neutron [req-c3866658-03bb-4e60-bf30-695d3057e69d req-cc18926d-c82c-4703-b60f-9dd282cd96c7 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Refreshing network info cache for port d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Start _get_guest_xml network_info=[{"id": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "address": "fa:16:3e:06:ff:f9", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9650c4a-cc", "ovs_interfaceid": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:49:01 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:49:01 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-369566994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-369566994',id=21,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-ghwz9fkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:48:59Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=6a44010b-9a96-4343-a35c-1f212d21e47b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "address": "fa:16:3e:06:ff:f9", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9650c4a-cc", "ovs_interfaceid": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "address": "fa:16:3e:06:ff:f9", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9650c4a-cc", "ovs_interfaceid": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:f9,bridge_name='br-int',has_traffic_filtering=True,id=d9650c4a-ccab-4a6a-8eff-d0dc24651e6b,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9650c4a-cc') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.objects.instance [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a44010b-9a96-4343-a35c-1f212d21e47b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:49:01 user nova-compute[72990]:   <uuid>6a44010b-9a96-4343-a35c-1f212d21e47b</uuid>
Aug 27 03:49:01 user nova-compute[72990]:   <name>instance-00000015</name>
Aug 27 03:49:01 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:49:01 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:49:01 user nova-compute[72990]:   <metadata>
Aug 27 03:49:01 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:49:01 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:49:01 user nova-compute[72990]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-369566994</nova:name>
Aug 27 03:49:01 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:49:01</nova:creationTime>
Aug 27 03:49:01 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:49:01 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:49:01 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:49:01 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:49:01 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:49:01 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:49:01 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:49:01 user nova-compute[72990]:       <nova:owner>
Aug 27 03:49:01 user nova-compute[72990]:         <nova:user uuid="858a63e8d5964f38ad776985cfbe9121">tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member</nova:user>
Aug 27 03:49:01 user nova-compute[72990]:         <nova:project uuid="183297ba5b6549fdb39f2135d92b3794">tempest-ServerBootFromVolumeStableRescueTest-1839224225</nova:project>
Aug 27 03:49:01 user nova-compute[72990]:       </nova:owner>
Aug 27 03:49:01 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:49:01 user nova-compute[72990]:       <nova:ports>
Aug 27 03:49:01 user nova-compute[72990]:         <nova:port uuid="d9650c4a-ccab-4a6a-8eff-d0dc24651e6b">
Aug 27 03:49:01 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 03:49:01 user nova-compute[72990]:         </nova:port>
Aug 27 03:49:01 user nova-compute[72990]:       </nova:ports>
Aug 27 03:49:01 user nova-compute[72990]:     </nova:instance>
Aug 27 03:49:01 user nova-compute[72990]:   </metadata>
Aug 27 03:49:01 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:49:01 user nova-compute[72990]:     <system>
Aug 27 03:49:01 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:49:01 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:49:01 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:49:01 user nova-compute[72990]:       <entry name="serial">6a44010b-9a96-4343-a35c-1f212d21e47b</entry>
Aug 27 03:49:01 user nova-compute[72990]:       <entry name="uuid">6a44010b-9a96-4343-a35c-1f212d21e47b</entry>
Aug 27 03:49:01 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:49:01 user nova-compute[72990]:     </system>
Aug 27 03:49:01 user nova-compute[72990]:   </sysinfo>
Aug 27 03:49:01 user nova-compute[72990]:   <os>
Aug 27 03:49:01 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:49:01 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:49:01 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:49:01 user nova-compute[72990]:   </os>
Aug 27 03:49:01 user nova-compute[72990]:   <features>
Aug 27 03:49:01 user nova-compute[72990]:     <acpi/>
Aug 27 03:49:01 user nova-compute[72990]:     <apic/>
Aug 27 03:49:01 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:49:01 user nova-compute[72990]:   </features>
Aug 27 03:49:01 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:49:01 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:49:01 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:49:01 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:49:01 user nova-compute[72990]:   </clock>
Aug 27 03:49:01 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:49:01 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:49:01 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:49:01 user nova-compute[72990]:   </cpu>
Aug 27 03:49:01 user nova-compute[72990]:   <devices>
Aug 27 03:49:01 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:49:01 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:49:01 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk"/>
Aug 27 03:49:01 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:49:01 user nova-compute[72990]:     </disk>
Aug 27 03:49:01 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:49:01 user nova-compute[72990]:       <mac address="fa:16:3e:06:ff:f9"/>
Aug 27 03:49:01 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:49:01 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:49:01 user nova-compute[72990]:       <target dev="tapd9650c4a-cc"/>
Aug 27 03:49:01 user nova-compute[72990]:     </interface>
Aug 27 03:49:01 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:49:01 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/console.log" append="off"/>
Aug 27 03:49:01 user nova-compute[72990]:     </serial>
Aug 27 03:49:01 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:49:01 user nova-compute[72990]:     <video>
Aug 27 03:49:01 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:49:01 user nova-compute[72990]:     </video>
Aug 27 03:49:01 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:49:01 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:49:01 user nova-compute[72990]:     </rng>
Aug 27 03:49:01 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:49:01 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:49:01 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:49:01 user nova-compute[72990]:     </memballoon>
Aug 27 03:49:01 user nova-compute[72990]:   </devices>
Aug 27 03:49:01 user nova-compute[72990]: </domain>
Aug 27 03:49:01 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-369566994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-369566994',id=21,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-ghwz9fkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:48:59Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=6a44010b-9a96-4343-a35c-1f212d21e47b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "address": "fa:16:3e:06:ff:f9", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9650c4a-cc", "ovs_interfaceid": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "address": "fa:16:3e:06:ff:f9", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9650c4a-cc", "ovs_interfaceid": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:f9,bridge_name='br-int',has_traffic_filtering=True,id=d9650c4a-ccab-4a6a-8eff-d0dc24651e6b,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9650c4a-cc') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG os_vif [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:f9,bridge_name='br-int',has_traffic_filtering=True,id=d9650c4a-ccab-4a6a-8eff-d0dc24651e6b,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9650c4a-cc') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9650c4a-cc, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9650c4a-cc, col_values=(('external_ids', {'iface-id': 'd9650c4a-ccab-4a6a-8eff-d0dc24651e6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:ff:f9', 'vm-uuid': '6a44010b-9a96-4343-a35c-1f212d21e47b'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:01 user nova-compute[72990]: INFO os_vif [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:f9,bridge_name='br-int',has_traffic_filtering=True,id=d9650c4a-ccab-4a6a-8eff-d0dc24651e6b,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9650c4a-cc')
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:49:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No VIF found with MAC fa:16:3e:06:ff:f9, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:49:02 user nova-compute[72990]: DEBUG nova.network.neutron [req-c3866658-03bb-4e60-bf30-695d3057e69d req-cc18926d-c82c-4703-b60f-9dd282cd96c7 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Updated VIF entry in instance network info cache for port d9650c4a-ccab-4a6a-8eff-d0dc24651e6b. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:49:02 user nova-compute[72990]: DEBUG nova.network.neutron [req-c3866658-03bb-4e60-bf30-695d3057e69d req-cc18926d-c82c-4703-b60f-9dd282cd96c7 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Updating instance_info_cache with network_info: [{"id": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "address": "fa:16:3e:06:ff:f9", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9650c4a-cc", "ovs_interfaceid": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:49:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c3866658-03bb-4e60-bf30-695d3057e69d req-cc18926d-c82c-4703-b60f-9dd282cd96c7 service nova] Releasing lock "refresh_cache-6a44010b-9a96-4343-a35c-1f212d21e47b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:49:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:03 user nova-compute[72990]: DEBUG nova.compute.manager [req-6f54e114-780f-4b0e-b9cf-d7d310777bec req-b4ad24a1-cbbc-4029-9dc2-b01dcb0b9914 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Received event network-vif-plugged-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:49:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6f54e114-780f-4b0e-b9cf-d7d310777bec req-b4ad24a1-cbbc-4029-9dc2-b01dcb0b9914 service nova] Acquiring lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6f54e114-780f-4b0e-b9cf-d7d310777bec req-b4ad24a1-cbbc-4029-9dc2-b01dcb0b9914 service nova] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6f54e114-780f-4b0e-b9cf-d7d310777bec req-b4ad24a1-cbbc-4029-9dc2-b01dcb0b9914 service nova] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:03 user nova-compute[72990]: DEBUG nova.compute.manager [req-6f54e114-780f-4b0e-b9cf-d7d310777bec req-b4ad24a1-cbbc-4029-9dc2-b01dcb0b9914 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] No waiting events found dispatching network-vif-plugged-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:49:03 user nova-compute[72990]: WARNING nova.compute.manager [req-6f54e114-780f-4b0e-b9cf-d7d310777bec req-b4ad24a1-cbbc-4029-9dc2-b01dcb0b9914 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Received unexpected event network-vif-plugged-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b for instance with vm_state building and task_state spawning.
Aug 27 03:49:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "15a88698-88d1-4c6b-9e40-98b618978a33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:03 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:49:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:03 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:49:03 user nova-compute[72990]: INFO nova.compute.claims [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Claim successful on node user
Aug 27 03:49:04 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:49:04 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:49:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:04 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:49:04 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:49:04 user nova-compute[72990]: DEBUG nova.network.neutron [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:49:04 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:49:04 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:49:04 user nova-compute[72990]: DEBUG nova.policy [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0631ab8ad8648e2912d4e554fbbe195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567ed48c72c547c6984851d6ba37e780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:49:04 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:49:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:49:04 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Creating image(s)
Aug 27 03:49:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "/opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "/opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "/opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.263s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-39d39100-b885-469f-bcc4-2b06ddeec8e3 req-0198cd7f-e271-4371-880b-51ac42f61c61 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Received event network-vif-plugged-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-39d39100-b885-469f-bcc4-2b06ddeec8e3 req-0198cd7f-e271-4371-880b-51ac42f61c61 service nova] Acquiring lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-39d39100-b885-469f-bcc4-2b06ddeec8e3 req-0198cd7f-e271-4371-880b-51ac42f61c61 service nova] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-39d39100-b885-469f-bcc4-2b06ddeec8e3 req-0198cd7f-e271-4371-880b-51ac42f61c61 service nova] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-39d39100-b885-469f-bcc4-2b06ddeec8e3 req-0198cd7f-e271-4371-880b-51ac42f61c61 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] No waiting events found dispatching network-vif-plugged-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:49:05 user nova-compute[72990]: WARNING nova.compute.manager [req-39d39100-b885-469f-bcc4-2b06ddeec8e3 req-0198cd7f-e271-4371-880b-51ac42f61c61 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Received unexpected event network-vif-plugged-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b for instance with vm_state building and task_state spawning.
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.239s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk 1073741824" returned: 0 in 0.067s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108145.5587451, 6a44010b-9a96-4343-a35c-1f212d21e47b => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:49:05 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] VM Resumed (Lifecycle Event)
Aug 27 03:49:05 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Instance spawned successfully.
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.272s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:05 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108145.5623171, 6a44010b-9a96-4343-a35c-1f212d21e47b => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:49:05 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] VM Started (Lifecycle Event)
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.network.neutron [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Successfully created port: 1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:49:05 user nova-compute[72990]: INFO nova.compute.manager [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Took 7.15 seconds to spawn the instance on the hypervisor.
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Cannot resize image /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Ensure instance console log exists: /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:05 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:49:05 user nova-compute[72990]: INFO nova.compute.manager [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Took 8.44 seconds to build instance.
Aug 27 03:49:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a85fe1d0-182b-46ac-a582-73f625a72938 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.590s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:06 user nova-compute[72990]: DEBUG nova.network.neutron [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Successfully updated port: 1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:49:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:49:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquired lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:49:06 user nova-compute[72990]: DEBUG nova.network.neutron [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:49:06 user nova-compute[72990]: DEBUG nova.compute.manager [req-58bcee7c-02ac-43cb-afa9-e9525ec66d73 req-a0f10deb-a3c3-4722-a24c-17b8efa53eb7 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-changed-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:49:06 user nova-compute[72990]: DEBUG nova.compute.manager [req-58bcee7c-02ac-43cb-afa9-e9525ec66d73 req-a0f10deb-a3c3-4722-a24c-17b8efa53eb7 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Refreshing instance network info cache due to event network-changed-1344eed9-36fe-4fce-a572-94a310f2d618. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:49:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-58bcee7c-02ac-43cb-afa9-e9525ec66d73 req-a0f10deb-a3c3-4722-a24c-17b8efa53eb7 service nova] Acquiring lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:49:06 user nova-compute[72990]: DEBUG nova.network.neutron [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.network.neutron [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updating instance_info_cache with network_info: [{"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Releasing lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Instance network_info: |[{"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-58bcee7c-02ac-43cb-afa9-e9525ec66d73 req-a0f10deb-a3c3-4722-a24c-17b8efa53eb7 service nova] Acquired lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.network.neutron [req-58bcee7c-02ac-43cb-afa9-e9525ec66d73 req-a0f10deb-a3c3-4722-a24c-17b8efa53eb7 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Refreshing network info cache for port 1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Start _get_guest_xml network_info=[{"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:49:07 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:49:07 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-931752626',display_name='tempest-ServerRescueNegativeTestJSON-server-931752626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-931752626',id=22,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0KVWF1WU6AFtBbBFdWiBdRcaer72AgRt0JV3tBDQqpR+utjPDLU9VGe36YKFhIncVurAQDbGkNQcA/aRjuUqCaWieSIs1x5jzh2ZRbb1KrdmRyCMe/3f0ttjSiAlwhig==',key_name='tempest-keypair-1761284820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='567ed48c72c547c6984851d6ba37e780',ramdisk_id='',reservation_id='r-92ss61f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-311406621',owner_user_name='tempest-ServerRescueNegativeTestJSON-311406621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:49:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0631ab8ad8648e2912d4e554fbbe195',uuid=15a88698-88d1-4c6b-9e40-98b618978a33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converting VIF {"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=1344eed9-36fe-4fce-a572-94a310f2d618,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344eed9-36') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.objects.instance [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'pci_devices' on Instance uuid 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:49:07 user nova-compute[72990]:   <uuid>15a88698-88d1-4c6b-9e40-98b618978a33</uuid>
Aug 27 03:49:07 user nova-compute[72990]:   <name>instance-00000016</name>
Aug 27 03:49:07 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:49:07 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:49:07 user nova-compute[72990]:   <metadata>
Aug 27 03:49:07 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:49:07 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:49:07 user nova-compute[72990]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-931752626</nova:name>
Aug 27 03:49:07 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:49:07</nova:creationTime>
Aug 27 03:49:07 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:49:07 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:49:07 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:49:07 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:49:07 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:49:07 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:49:07 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:49:07 user nova-compute[72990]:       <nova:owner>
Aug 27 03:49:07 user nova-compute[72990]:         <nova:user uuid="f0631ab8ad8648e2912d4e554fbbe195">tempest-ServerRescueNegativeTestJSON-311406621-project-member</nova:user>
Aug 27 03:49:07 user nova-compute[72990]:         <nova:project uuid="567ed48c72c547c6984851d6ba37e780">tempest-ServerRescueNegativeTestJSON-311406621</nova:project>
Aug 27 03:49:07 user nova-compute[72990]:       </nova:owner>
Aug 27 03:49:07 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:49:07 user nova-compute[72990]:       <nova:ports>
Aug 27 03:49:07 user nova-compute[72990]:         <nova:port uuid="1344eed9-36fe-4fce-a572-94a310f2d618">
Aug 27 03:49:07 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 03:49:07 user nova-compute[72990]:         </nova:port>
Aug 27 03:49:07 user nova-compute[72990]:       </nova:ports>
Aug 27 03:49:07 user nova-compute[72990]:     </nova:instance>
Aug 27 03:49:07 user nova-compute[72990]:   </metadata>
Aug 27 03:49:07 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:49:07 user nova-compute[72990]:     <system>
Aug 27 03:49:07 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:49:07 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:49:07 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:49:07 user nova-compute[72990]:       <entry name="serial">15a88698-88d1-4c6b-9e40-98b618978a33</entry>
Aug 27 03:49:07 user nova-compute[72990]:       <entry name="uuid">15a88698-88d1-4c6b-9e40-98b618978a33</entry>
Aug 27 03:49:07 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:49:07 user nova-compute[72990]:     </system>
Aug 27 03:49:07 user nova-compute[72990]:   </sysinfo>
Aug 27 03:49:07 user nova-compute[72990]:   <os>
Aug 27 03:49:07 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:49:07 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:49:07 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:49:07 user nova-compute[72990]:   </os>
Aug 27 03:49:07 user nova-compute[72990]:   <features>
Aug 27 03:49:07 user nova-compute[72990]:     <acpi/>
Aug 27 03:49:07 user nova-compute[72990]:     <apic/>
Aug 27 03:49:07 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:49:07 user nova-compute[72990]:   </features>
Aug 27 03:49:07 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:49:07 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:49:07 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:49:07 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:49:07 user nova-compute[72990]:   </clock>
Aug 27 03:49:07 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:49:07 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:49:07 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:49:07 user nova-compute[72990]:   </cpu>
Aug 27 03:49:07 user nova-compute[72990]:   <devices>
Aug 27 03:49:07 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:49:07 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:49:07 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk"/>
Aug 27 03:49:07 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:49:07 user nova-compute[72990]:     </disk>
Aug 27 03:49:07 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:49:07 user nova-compute[72990]:       <mac address="fa:16:3e:36:a6:b0"/>
Aug 27 03:49:07 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:49:07 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:49:07 user nova-compute[72990]:       <target dev="tap1344eed9-36"/>
Aug 27 03:49:07 user nova-compute[72990]:     </interface>
Aug 27 03:49:07 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:49:07 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/console.log" append="off"/>
Aug 27 03:49:07 user nova-compute[72990]:     </serial>
Aug 27 03:49:07 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:49:07 user nova-compute[72990]:     <video>
Aug 27 03:49:07 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:49:07 user nova-compute[72990]:     </video>
Aug 27 03:49:07 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:49:07 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:49:07 user nova-compute[72990]:     </rng>
Aug 27 03:49:07 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:49:07 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:49:07 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:49:07 user nova-compute[72990]:     </memballoon>
Aug 27 03:49:07 user nova-compute[72990]:   </devices>
Aug 27 03:49:07 user nova-compute[72990]: </domain>
Aug 27 03:49:07 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-931752626',display_name='tempest-ServerRescueNegativeTestJSON-server-931752626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-931752626',id=22,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0KVWF1WU6AFtBbBFdWiBdRcaer72AgRt0JV3tBDQqpR+utjPDLU9VGe36YKFhIncVurAQDbGkNQcA/aRjuUqCaWieSIs1x5jzh2ZRbb1KrdmRyCMe/3f0ttjSiAlwhig==',key_name='tempest-keypair-1761284820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='567ed48c72c547c6984851d6ba37e780',ramdisk_id='',reservation_id='r-92ss61f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-311406621',owner_user_name='tempest-ServerRescueNegativeTestJSON-311406621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:49:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0631ab8ad8648e2912d4e554fbbe195',uuid=15a88698-88d1-4c6b-9e40-98b618978a33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converting VIF {"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=1344eed9-36fe-4fce-a572-94a310f2d618,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344eed9-36') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG os_vif [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=1344eed9-36fe-4fce-a572-94a310f2d618,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344eed9-36') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1344eed9-36, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1344eed9-36, col_values=(('external_ids', {'iface-id': '1344eed9-36fe-4fce-a572-94a310f2d618', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:a6:b0', 'vm-uuid': '15a88698-88d1-4c6b-9e40-98b618978a33'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:07 user nova-compute[72990]: INFO os_vif [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=1344eed9-36fe-4fce-a572-94a310f2d618,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344eed9-36')
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:49:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No VIF found with MAC fa:16:3e:36:a6:b0, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:49:08 user nova-compute[72990]: DEBUG nova.network.neutron [req-58bcee7c-02ac-43cb-afa9-e9525ec66d73 req-a0f10deb-a3c3-4722-a24c-17b8efa53eb7 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updated VIF entry in instance network info cache for port 1344eed9-36fe-4fce-a572-94a310f2d618. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:49:08 user nova-compute[72990]: DEBUG nova.network.neutron [req-58bcee7c-02ac-43cb-afa9-e9525ec66d73 req-a0f10deb-a3c3-4722-a24c-17b8efa53eb7 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updating instance_info_cache with network_info: [{"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:49:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-58bcee7c-02ac-43cb-afa9-e9525ec66d73 req-a0f10deb-a3c3-4722-a24c-17b8efa53eb7 service nova] Releasing lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:49:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108151.6713383, 15a88698-88d1-4c6b-9e40-98b618978a33 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:49:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] VM Resumed (Lifecycle Event)
Aug 27 03:49:11 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Instance spawned successfully.
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108151.6804266, 15a88698-88d1-4c6b-9e40-98b618978a33 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:49:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] VM Started (Lifecycle Event)
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:49:11 user nova-compute[72990]: INFO nova.compute.manager [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Took 7.04 seconds to spawn the instance on the hypervisor.
Aug 27 03:49:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:49:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:49:11 user nova-compute[72990]: INFO nova.compute.manager [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Took 8.13 seconds to build instance.
Aug 27 03:49:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3e738861-fa95-44b7-a794-e0d735bd6a0f tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "15a88698-88d1-4c6b-9e40-98b618978a33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.285s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-ccfb2d1f-f231-4d10-91a7-03bdb614706b req-059a5fba-a8eb-4e58-9581-f0efd1c044cc service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:49:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ccfb2d1f-f231-4d10-91a7-03bdb614706b req-059a5fba-a8eb-4e58-9581-f0efd1c044cc service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ccfb2d1f-f231-4d10-91a7-03bdb614706b req-059a5fba-a8eb-4e58-9581-f0efd1c044cc service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ccfb2d1f-f231-4d10-91a7-03bdb614706b req-059a5fba-a8eb-4e58-9581-f0efd1c044cc service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-ccfb2d1f-f231-4d10-91a7-03bdb614706b req-059a5fba-a8eb-4e58-9581-f0efd1c044cc service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:49:13 user nova-compute[72990]: WARNING nova.compute.manager [req-ccfb2d1f-f231-4d10-91a7-03bdb614706b req-059a5fba-a8eb-4e58-9581-f0efd1c044cc service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state active and task_state None.
Aug 27 03:49:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-54d816ee-940b-49af-bd3b-3a079bd3d9ae req-a7631697-463b-470d-8d9f-17850acbb9d3 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Received event network-changed-ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:49:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-54d816ee-940b-49af-bd3b-3a079bd3d9ae req-a7631697-463b-470d-8d9f-17850acbb9d3 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Refreshing instance network info cache due to event network-changed-ed0518e1-05ee-4dde-b386-b83977c4872c. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:49:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-54d816ee-940b-49af-bd3b-3a079bd3d9ae req-a7631697-463b-470d-8d9f-17850acbb9d3 service nova] Acquiring lock "refresh_cache-9052a337-efb8-4a79-95c1-685d22966cec" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:49:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-54d816ee-940b-49af-bd3b-3a079bd3d9ae req-a7631697-463b-470d-8d9f-17850acbb9d3 service nova] Acquired lock "refresh_cache-9052a337-efb8-4a79-95c1-685d22966cec" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:49:14 user nova-compute[72990]: DEBUG nova.network.neutron [req-54d816ee-940b-49af-bd3b-3a079bd3d9ae req-a7631697-463b-470d-8d9f-17850acbb9d3 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Refreshing network info cache for port ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:49:14 user nova-compute[72990]: DEBUG nova.network.neutron [req-54d816ee-940b-49af-bd3b-3a079bd3d9ae req-a7631697-463b-470d-8d9f-17850acbb9d3 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Updated VIF entry in instance network info cache for port ed0518e1-05ee-4dde-b386-b83977c4872c. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:49:14 user nova-compute[72990]: DEBUG nova.network.neutron [req-54d816ee-940b-49af-bd3b-3a079bd3d9ae req-a7631697-463b-470d-8d9f-17850acbb9d3 service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Updating instance_info_cache with network_info: [{"id": "ed0518e1-05ee-4dde-b386-b83977c4872c", "address": "fa:16:3e:c9:9e:a3", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0518e1-05", "ovs_interfaceid": "ed0518e1-05ee-4dde-b386-b83977c4872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:49:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-54d816ee-940b-49af-bd3b-3a079bd3d9ae req-a7631697-463b-470d-8d9f-17850acbb9d3 service nova] Releasing lock "refresh_cache-9052a337-efb8-4a79-95c1-685d22966cec" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:49:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-b63bf72c-4ccb-436b-981b-2fbffdd55c59 req-d3cbb458-4860-4b5a-9a1e-9dcd6d30f295 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:49:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b63bf72c-4ccb-436b-981b-2fbffdd55c59 req-d3cbb458-4860-4b5a-9a1e-9dcd6d30f295 service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b63bf72c-4ccb-436b-981b-2fbffdd55c59 req-d3cbb458-4860-4b5a-9a1e-9dcd6d30f295 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b63bf72c-4ccb-436b-981b-2fbffdd55c59 req-d3cbb458-4860-4b5a-9a1e-9dcd6d30f295 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-b63bf72c-4ccb-436b-981b-2fbffdd55c59 req-d3cbb458-4860-4b5a-9a1e-9dcd6d30f295 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:49:15 user nova-compute[72990]: WARNING nova.compute.manager [req-b63bf72c-4ccb-436b-981b-2fbffdd55c59 req-d3cbb458-4860-4b5a-9a1e-9dcd6d30f295 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state active and task_state None.
Aug 27 03:49:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "9052a337-efb8-4a79-95c1-685d22966cec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "9052a337-efb8-4a79-95c1-685d22966cec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'flavor' on Instance uuid 9052a337-efb8-4a79-95c1-685d22966cec {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:49:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "9052a337-efb8-4a79-95c1-685d22966cec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "9052a337-efb8-4a79-95c1-685d22966cec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "9052a337-efb8-4a79-95c1-685d22966cec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.008s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:19 user nova-compute[72990]: INFO nova.compute.manager [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Attaching volume 6e0980b2-b31f-4053-8518-bf4ddd3e007e to /dev/vdb
Aug 27 03:49:19 user nova-compute[72990]: DEBUG os_brick.utils [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46a826c-ef49-494d-9b9d-d09e10a667c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0ca31c-c729-4a60-bc01-942b167a9483]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd3577d-9c6c-41b3-ae66-8258dacbd16b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[87663bf3-374b-45ab-861a-913c0011a08a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:49:19 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:49:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c790613-2324-41af-a3d1-1b106a02c27f]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG os_brick.utils [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:49:19 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Updating existing volume attachment record: 2de21139-3dc3-437d-90c4-ca1e9386607a {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:49:20 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:49:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:23 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:49:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:49:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:49:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:23 user nova-compute[72990]: DEBUG nova.objects.instance [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lazy-loading 'flavor' on Instance uuid 338682cb-8c70-49c3-b88c-362e96ec8fb1 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:49:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:49:23 user nova-compute[72990]: INFO nova.compute.claims [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Claim successful on node user
Aug 27 03:49:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:24 user nova-compute[72990]: INFO nova.compute.manager [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Attaching volume 0edcdf64-da71-43a8-b27d-b9cc7a7bbeba to /dev/vdb
Aug 27 03:49:24 user nova-compute[72990]: DEBUG os_brick.utils [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5229164-8ce7-4e64-9bfe-d2358c7b88b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65c9e97-5e8b-4029-8697-6a61ccc8ee67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c9d510-2122-4781-9068-e4a80f91592c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1681aa-d666-4e24-83ab-e38219845d8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:49:24 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bf7b74-48b9-4825-8a8e-bd612336856d]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG os_brick.utils [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating existing volume attachment record: a731e2f6-cdb0-4c60-85dc-5542e2008971 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG nova.network.neutron [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:49:24 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:49:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:49:24 user nova-compute[72990]: INFO nova.virt.block_device [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Booting with volume 3798f977-b6a9-4589-a6a5-b28f7ea136a0 at /dev/vda
Aug 27 03:49:24 user nova-compute[72990]: DEBUG nova.policy [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b91e477a683a499a93952e484480f4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062c6a1b8e4e405cb53c04da895064a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG os_brick.utils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da95473-b602-4495-b4cb-d438fef7e02b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f2ff91-b52d-4dbb-b7aa-a98d8332c534]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1388748-2e64-4aae-ba55-22ac96d438e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[88753fac-2085-4757-a005-50fa103663bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:49:24 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:49:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8ab7e3-d0fb-4a96-a261-a90949791e68]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:49:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:49:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:49:25 user nova-compute[72990]: DEBUG os_brick.utils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:49:25 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Updating existing volume attachment record: 2f0ed3aa-ef20-4a8b-85b2-6fad9d583bde {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:49:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Successfully created port: 8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:49:25 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:49:25 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:49:25 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Successfully updated port: 8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "refresh_cache-c540f8c5-8827-4991-bee7-e2fce0c2d978" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquired lock "refresh_cache-c540f8c5-8827-4991-bee7-e2fce0c2d978" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-74f8121d-3fdd-4d8c-8354-5139104d2fd3 req-9e190b48-13a0-47e9-812c-ab0c05d11603 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event network-changed-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-74f8121d-3fdd-4d8c-8354-5139104d2fd3 req-9e190b48-13a0-47e9-812c-ab0c05d11603 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Refreshing instance network info cache due to event network-changed-8682c013-92cc-4a9a-bb77-a69abc07cd0c. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-74f8121d-3fdd-4d8c-8354-5139104d2fd3 req-9e190b48-13a0-47e9-812c-ab0c05d11603 service nova] Acquiring lock "refresh_cache-c540f8c5-8827-4991-bee7-e2fce0c2d978" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Updating instance_info_cache with network_info: [{"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Releasing lock "refresh_cache-c540f8c5-8827-4991-bee7-e2fce0c2d978" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Instance network_info: |[{"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-74f8121d-3fdd-4d8c-8354-5139104d2fd3 req-9e190b48-13a0-47e9-812c-ab0c05d11603 service nova] Acquired lock "refresh_cache-c540f8c5-8827-4991-bee7-e2fce0c2d978" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:49:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-74f8121d-3fdd-4d8c-8354-5139104d2fd3 req-9e190b48-13a0-47e9-812c-ab0c05d11603 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Refreshing network info cache for port 8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:49:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:27 user nova-compute[72990]: DEBUG nova.network.neutron [req-74f8121d-3fdd-4d8c-8354-5139104d2fd3 req-9e190b48-13a0-47e9-812c-ab0c05d11603 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Updated VIF entry in instance network info cache for port 8682c013-92cc-4a9a-bb77-a69abc07cd0c. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:49:27 user nova-compute[72990]: DEBUG nova.network.neutron [req-74f8121d-3fdd-4d8c-8354-5139104d2fd3 req-9e190b48-13a0-47e9-812c-ab0c05d11603 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Updating instance_info_cache with network_info: [{"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:49:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:49:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-74f8121d-3fdd-4d8c-8354-5139104d2fd3 req-9e190b48-13a0-47e9-812c-ab0c05d11603 service nova] Releasing lock "refresh_cache-c540f8c5-8827-4991-bee7-e2fce0c2d978" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:49:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:27 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:49:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:49:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:49:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woaDzTcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:49:32 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:49:32 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:49:32 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb8dace-fea7-4836-b33a-cb467080d53c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:49:32 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[95edf63c-a3ac-4a15-b44d-c0836a29eff6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e] added
Aug 27 03:49:32 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a065b342-4f6d-4e81-a29c-8674f57bd8a6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a30ba0-9558-45ff-87f9-6f431232d0cb]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woaDzTcI {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woaDzTcI" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[419c42e1-a99f-4ef7-a5d9-d9bd458749d3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'woaDzTcI'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c7ac8b-2479-4113-be67-361850aa7c27]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9042c248-d089-4a74-b727-418a4d191339]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:32 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:32 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4868dd-2fce-41b4-bf16-f6ebf4e9b300]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e, portal: 172.16.0.220,3260]
Aug 27 03:49:32 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e, portal: 172.16.0.220,3260] successful.
Aug 27 03:49:32 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[606d6f72-2d7e-4320-9bb7-29e9b7989315]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2353ac-ec32-46ce-83d4-886415dac655]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)
Aug 27 03:49:32 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:32 user nova-compute[72990]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)
Aug 27 03:49:32 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c2cb63-8808-4d2f-80e1-a89d854b93a2]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woaDzTcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:32 user nova-compute[72990]: INFO nova.compute.manager [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Detaching volume 0932a7f4-a646-4455-a1e4-ec89ce3c1deb
Aug 27 03:49:32 user nova-compute[72990]: INFO nova.virt.block_device [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Attempting to driver detach volume 0932a7f4-a646-4455-a1e4-ec89ce3c1deb from mountpoint /dev/vdb
Aug 27 03:49:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Attempting to detach device vdb from instance ed1742b9-a19d-43f9-b39a-7257261f858c from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:49:32 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:49:32 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 03:49:32 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:49:32 user nova-compute[72990]:   <serial>0932a7f4-a646-4455-a1e4-ec89ce3c1deb</serial>
Aug 27 03:49:32 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 03:49:32 user nova-compute[72990]: </disk>
Aug 27 03:49:32 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:49:32 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully detached device vdb from instance ed1742b9-a19d-43f9-b39a-7257261f858c from the persistent domain config.
Aug 27 03:49:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed1742b9-a19d-43f9-b39a-7257261f858c from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:49:32 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:49:32 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 03:49:32 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:49:32 user nova-compute[72990]:   <serial>0932a7f4-a646-4455-a1e4-ec89ce3c1deb</serial>
Aug 27 03:49:32 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 03:49:32 user nova-compute[72990]: </disk>
Aug 27 03:49:32 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693108173.2950735, ed1742b9-a19d-43f9-b39a-7257261f858c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.649s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] <== connect_volume: return (1652ms) {'type': 'block', 'scsi_wwn': '26661383239366330', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661383239366330', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed1742b9-a19d-43f9-b39a-7257261f858c {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:49:33 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully detached device vdb from instance ed1742b9-a19d-43f9-b39a-7257261f858c from the live domain config.
Aug 27 03:49:33 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:49:33 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7090MB free_disk=25.101402282714844GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiNAcEjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:49:33 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.objects.instance [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'flavor' on Instance uuid 9052a337-efb8-4a79-95c1-685d22966cec {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[672c24b8-bbc4-472c-b1aa-2c27e329d866]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:49:33 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:49:33 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 03:49:33 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:49:33 user nova-compute[72990]:   <serial>6e0980b2-b31f-4053-8518-bf4ddd3e007e</serial>
Aug 27 03:49:33 user nova-compute[72990]: </disk>
Aug 27 03:49:33 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46dd277-3f0d-4cbc-b50c-cdb6b43fdf7a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:33 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:33 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:49:33 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:33 user nova-compute[72990]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)
Aug 27 03:49:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:33 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:33 user nova-compute[72990]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb (non-flash)
Aug 27 03:49:33 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:33 user nova-compute[72990]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)
Aug 27 03:49:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44a3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb'): ({'sdd'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Removing single pathed devices sdd {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa95556-617a-413e-926f-98687c0bfa5a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ef7a0a-5394-48a7-b0a5-77c3e43bfaea]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flushing IO for device /dev/sdd {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8796f21-dd16-4ab1-a88d-a9ad1ad969a3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ed1742b9-a19d-43f9-b39a-7257261f858c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 338682cb-8c70-49c3-b88c-362e96ec8fb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 9052a337-efb8-4a79-95c1-685d22966cec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 1e81de88-259e-4124-8e2c-cafd310a9b42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 6a44010b-9a96-4343-a35c-1f212d21e47b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 15a88698-88d1-4c6b-9e40-98b618978a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance c540f8c5-8827-4991-bee7-e2fce0c2d978 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56affbc-e6a0-41a0-90d8-25ce79747c9d]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dece4392-943e-4434-9a7a-af6c71125354]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[959aa500-bafb-4a2a-8eeb-1e917c90b5f6]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260]
Aug 27 03:49:33 user nova-compute[72990]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb, portal: 172.16.0.220,3260] successful.
Aug 27 03:49:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0932a7f4-a646-4455-a1e4-ec89ce3c1deb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e240c47b-c751-4467-a4fb-59de077c69fa]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== disconnect_volume: return (344ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No VIF found with MAC fa:16:3e:c9:9e:a3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:49:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-56021912-ed7c-4bc3-8a13-0b39e7dde0c0 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "9052a337-efb8-4a79-95c1-685d22966cec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.018s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:49:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Creating image(s)
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Ensure instance console log exists: /opt/stack/data/nova/instances/c540f8c5-8827-4991-bee7-e2fce0c2d978/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Start _get_guest_xml network_info=[{"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '2f0ed3aa-ef20-4a8b-85b2-6fad9d583bde', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVFDMfqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c540f8c5-8827-4991-bee7-e2fce0c2d978', 'attached_at': '', 'detached_at': '', 'volume_id': '3798f977-b6a9-4589-a6a5-b28f7ea136a0', 'serial': '3798f977-b6a9-4589-a6a5-b28f7ea136a0'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:49:37 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:49:37 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVFDMfqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:49:37 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:49:37 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:49:37 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b92ca26-8f18-4864-a69e-d573d7510f7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:49:37 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f28a983-3cd1-4007-bced-674a9366cf08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0] added
Aug 27 03:49:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[688fe98d-66b5-4ab7-abde-917ade7eda06]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4818f0-9525-4a3b-8942-a2cf25ecb5e6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVFDMfqx {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVFDMfqx" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[026293bb-32d6-4e01-b11d-6c831c690c70]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NVFDMfqx'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[43359742-11a6-4e0d-8f57-b495c0789e04]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9abd5bb-0e64-4dc7-8f9f-36b5481de0ca]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)
Aug 27 03:49:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)
Aug 27 03:49:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[469050cb-eb19-4201-a0c6-597babfd6ed0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260]
Aug 27 03:49:37 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260] successful.
Aug 27 03:49:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "9052a337-efb8-4a79-95c1-685d22966cec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "9052a337-efb8-4a79-95c1-685d22966cec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d74be1-3d0f-4dad-b65e-eb59107d8159]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:37 user nova-compute[72990]: INFO nova.compute.manager [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Detaching volume 6e0980b2-b31f-4053-8518-bf4ddd3e007e
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bedba57-de06-4d90-82b2-187660b861a6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:49:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)
Aug 27 03:49:37 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:49:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e582c62-f76c-4f37-80af-d3dee31f2a97]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:49:37 user nova-compute[72990]: INFO nova.virt.block_device [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Attempting to driver detach volume 6e0980b2-b31f-4053-8518-bf4ddd3e007e from mountpoint /dev/vdb
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Attempting to detach device vdb from instance 9052a337-efb8-4a79-95c1-685d22966cec from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:49:37 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:49:37 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 03:49:37 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:49:37 user nova-compute[72990]:   <serial>6e0980b2-b31f-4053-8518-bf4ddd3e007e</serial>
Aug 27 03:49:37 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:49:37 user nova-compute[72990]: </disk>
Aug 27 03:49:37 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:49:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully detached device vdb from instance 9052a337-efb8-4a79-95c1-685d22966cec from the persistent domain config.
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9052a337-efb8-4a79-95c1-685d22966cec from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:49:37 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:49:37 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 03:49:37 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:49:37 user nova-compute[72990]:   <serial>6e0980b2-b31f-4053-8518-bf4ddd3e007e</serial>
Aug 27 03:49:37 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:49:37 user nova-compute[72990]: </disk>
Aug 27 03:49:37 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:49:37 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Updating instance_info_cache with network_info: [{"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693108178.2927506, 9052a337-efb8-4a79-95c1-685d22966cec => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9052a337-efb8-4a79-95c1-685d22966cec {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:49:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully detached device vdb from instance 9052a337-efb8-4a79-95c1-685d22966cec from the live domain config.
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woaDzTcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:49:38 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVFDMfqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23561656536623233', 'path': '/dev/sdd'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561656536623233', 'path': '/dev/sdd'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.496s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f54cc2-b6bc-4605-9a9a-3633bb38154c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-673714117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-673714117',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3PAyQeday+k2IVElwpEXGXjfzzJ3SXG/LO6/dnOTC3QPukrFT+NJp9oRqOaHwRI++w7DioJsEXHO6yZTpNitN00RbRTemlQN1FB2LLFWDsMykIWyCtKESzmuLVzHdmnQ==',key_name='tempest-keypair-1971563117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='062c6a1b8e4e405cb53c04da895064a6',ramdisk_id='',reservation_id='r-adnhkrxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-46885198',owner_user_name='tempest-ServerActionsV293TestJSON-46885198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91e477a683a499a93952e484480f4dd',uuid=c540f8c5-8827-4991-bee7-e2fce0c2d978,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Converting VIF {"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.objects.instance [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lazy-loading 'pci_devices' on Instance uuid c540f8c5-8827-4991-bee7-e2fce0c2d978 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:49:38 user nova-compute[72990]:   <uuid>c540f8c5-8827-4991-bee7-e2fce0c2d978</uuid>
Aug 27 03:49:38 user nova-compute[72990]:   <name>instance-00000017</name>
Aug 27 03:49:38 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:49:38 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:49:38 user nova-compute[72990]:   <metadata>
Aug 27 03:49:38 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:49:38 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:49:38 user nova-compute[72990]:       <nova:name>tempest-ServerActionsV293TestJSON-server-673714117</nova:name>
Aug 27 03:49:38 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:49:37</nova:creationTime>
Aug 27 03:49:38 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:49:38 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:49:38 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:49:38 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:49:38 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:49:38 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:49:38 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:49:38 user nova-compute[72990]:       <nova:owner>
Aug 27 03:49:38 user nova-compute[72990]:         <nova:user uuid="b91e477a683a499a93952e484480f4dd">tempest-ServerActionsV293TestJSON-46885198-project-member</nova:user>
Aug 27 03:49:38 user nova-compute[72990]:         <nova:project uuid="062c6a1b8e4e405cb53c04da895064a6">tempest-ServerActionsV293TestJSON-46885198</nova:project>
Aug 27 03:49:38 user nova-compute[72990]:       </nova:owner>
Aug 27 03:49:38 user nova-compute[72990]:       <nova:ports>
Aug 27 03:49:38 user nova-compute[72990]:         <nova:port uuid="8682c013-92cc-4a9a-bb77-a69abc07cd0c">
Aug 27 03:49:38 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 03:49:38 user nova-compute[72990]:         </nova:port>
Aug 27 03:49:38 user nova-compute[72990]:       </nova:ports>
Aug 27 03:49:38 user nova-compute[72990]:     </nova:instance>
Aug 27 03:49:38 user nova-compute[72990]:   </metadata>
Aug 27 03:49:38 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:49:38 user nova-compute[72990]:     <system>
Aug 27 03:49:38 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:49:38 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:49:38 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:49:38 user nova-compute[72990]:       <entry name="serial">c540f8c5-8827-4991-bee7-e2fce0c2d978</entry>
Aug 27 03:49:38 user nova-compute[72990]:       <entry name="uuid">c540f8c5-8827-4991-bee7-e2fce0c2d978</entry>
Aug 27 03:49:38 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:49:38 user nova-compute[72990]:     </system>
Aug 27 03:49:38 user nova-compute[72990]:   </sysinfo>
Aug 27 03:49:38 user nova-compute[72990]:   <os>
Aug 27 03:49:38 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:49:38 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:49:38 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:49:38 user nova-compute[72990]:   </os>
Aug 27 03:49:38 user nova-compute[72990]:   <features>
Aug 27 03:49:38 user nova-compute[72990]:     <acpi/>
Aug 27 03:49:38 user nova-compute[72990]:     <apic/>
Aug 27 03:49:38 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:49:38 user nova-compute[72990]:   </features>
Aug 27 03:49:38 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:49:38 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:49:38 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:49:38 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:49:38 user nova-compute[72990]:   </clock>
Aug 27 03:49:38 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:49:38 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:49:38 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:49:38 user nova-compute[72990]:   </cpu>
Aug 27 03:49:38 user nova-compute[72990]:   <devices>
Aug 27 03:49:38 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:49:38 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:49:38 user nova-compute[72990]:       <source dev="/dev/sdd"/>
Aug 27 03:49:38 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:49:38 user nova-compute[72990]:       <serial>3798f977-b6a9-4589-a6a5-b28f7ea136a0</serial>
Aug 27 03:49:38 user nova-compute[72990]:     </disk>
Aug 27 03:49:38 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:49:38 user nova-compute[72990]:       <mac address="fa:16:3e:c7:b6:d4"/>
Aug 27 03:49:38 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:49:38 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:49:38 user nova-compute[72990]:       <target dev="tap8682c013-92"/>
Aug 27 03:49:38 user nova-compute[72990]:     </interface>
Aug 27 03:49:38 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:49:38 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/c540f8c5-8827-4991-bee7-e2fce0c2d978/console.log" append="off"/>
Aug 27 03:49:38 user nova-compute[72990]:     </serial>
Aug 27 03:49:38 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:49:38 user nova-compute[72990]:     <video>
Aug 27 03:49:38 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:49:38 user nova-compute[72990]:     </video>
Aug 27 03:49:38 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:49:38 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:49:38 user nova-compute[72990]:     </rng>
Aug 27 03:49:38 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:49:38 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:49:38 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:49:38 user nova-compute[72990]:     </memballoon>
Aug 27 03:49:38 user nova-compute[72990]:   </devices>
Aug 27 03:49:38 user nova-compute[72990]: </domain>
Aug 27 03:49:38 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-673714117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-673714117',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3PAyQeday+k2IVElwpEXGXjfzzJ3SXG/LO6/dnOTC3QPukrFT+NJp9oRqOaHwRI++w7DioJsEXHO6yZTpNitN00RbRTemlQN1FB2LLFWDsMykIWyCtKESzmuLVzHdmnQ==',key_name='tempest-keypair-1971563117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='062c6a1b8e4e405cb53c04da895064a6',ramdisk_id='',reservation_id='r-adnhkrxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-46885198',owner_user_name='tempest-ServerActionsV293TestJSON-46885198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91e477a683a499a93952e484480f4dd',uuid=c540f8c5-8827-4991-bee7-e2fce0c2d978,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Converting VIF {"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_vif [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[81574ca0-fe21-42c8-aa1f-91ef438d6528]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:38 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:38 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:38 user nova-compute[72990]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)
Aug 27 03:49:38 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:49:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:38 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:38 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:38 user nova-compute[72990]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e (non-flash)
Aug 27 03:49:38 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:49:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44dde10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8682c013-92, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8682c013-92, col_values=(('external_ids', {'iface-id': '8682c013-92cc-4a9a-bb77-a69abc07cd0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:b6:d4', 'vm-uuid': 'c540f8c5-8827-4991-bee7-e2fce0c2d978'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:38 user nova-compute[72990]: INFO os_vif [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92')
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75be63e-34d4-4bb2-8816-ba658fe40b3b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a7d10-be96-4a12-8caa-81f253bbcb7e]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54b418d-4e57-43d2-8bbf-afe10fbcaa71]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] No VIF found with MAC fa:16:3e:c7:b6:d4, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[936025c5-1fde-4068-98dd-390223369caa]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b8c030-b9e9-4c8a-97a8-f3e8058b364a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1bbdc5-fe40-41e7-9085-fb725ac69ba4]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e, portal: 172.16.0.220,3260]
Aug 27 03:49:39 user nova-compute[72990]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e, portal: 172.16.0.220,3260] successful.
Aug 27 03:49:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0980b2-b31f-4053-8518-bf4ddd3e007e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8db879-57d8-4c90-9e9d-ef5d42d9610c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:49:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] <== disconnect_volume: return (798ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:49:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:49:39 user nova-compute[72990]: DEBUG nova.objects.instance [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'flavor' on Instance uuid 9052a337-efb8-4a79-95c1-685d22966cec {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:49:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-defb9b9e-9f83-4910-82a8-eaec1d50c509 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "9052a337-efb8-4a79-95c1-685d22966cec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.199s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-b4c039ba-17fc-4d52-8fd2-0473a39b61db req-9fa944d9-3a4f-43bd-9f5e-85d754bed2fe service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:49:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b4c039ba-17fc-4d52-8fd2-0473a39b61db req-9fa944d9-3a4f-43bd-9f5e-85d754bed2fe service nova] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b4c039ba-17fc-4d52-8fd2-0473a39b61db req-9fa944d9-3a4f-43bd-9f5e-85d754bed2fe service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b4c039ba-17fc-4d52-8fd2-0473a39b61db req-9fa944d9-3a4f-43bd-9f5e-85d754bed2fe service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-b4c039ba-17fc-4d52-8fd2-0473a39b61db req-9fa944d9-3a4f-43bd-9f5e-85d754bed2fe service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] No waiting events found dispatching network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:49:40 user nova-compute[72990]: WARNING nova.compute.manager [req-b4c039ba-17fc-4d52-8fd2-0473a39b61db req-9fa944d9-3a4f-43bd-9f5e-85d754bed2fe service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received unexpected event network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c for instance with vm_state building and task_state spawning.
Aug 27 03:49:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108182.3845224, c540f8c5-8827-4991-bee7-e2fce0c2d978 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:49:42 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] VM Resumed (Lifecycle Event)
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:49:42 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Instance spawned successfully.
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:49:42 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108182.3876045, c540f8c5-8827-4991-bee7-e2fce0c2d978 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:49:42 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] VM Started (Lifecycle Event)
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:49:42 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:49:42 user nova-compute[72990]: INFO nova.compute.manager [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-2c5cbbe1-f070-4f9a-b75d-67531d80de24 req-27034241-eb1e-4658-b133-941746413815 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2c5cbbe1-f070-4f9a-b75d-67531d80de24 req-27034241-eb1e-4658-b133-941746413815 service nova] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2c5cbbe1-f070-4f9a-b75d-67531d80de24 req-27034241-eb1e-4658-b133-941746413815 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2c5cbbe1-f070-4f9a-b75d-67531d80de24 req-27034241-eb1e-4658-b133-941746413815 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-2c5cbbe1-f070-4f9a-b75d-67531d80de24 req-27034241-eb1e-4658-b133-941746413815 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] No waiting events found dispatching network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:49:42 user nova-compute[72990]: WARNING nova.compute.manager [req-2c5cbbe1-f070-4f9a-b75d-67531d80de24 req-27034241-eb1e-4658-b133-941746413815 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received unexpected event network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c for instance with vm_state building and task_state spawning.
Aug 27 03:49:42 user nova-compute[72990]: INFO nova.compute.manager [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Took 18.67 seconds to build instance.
Aug 27 03:49:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-171c3bdf-e71d-49d8-b0ac-64cac09dad36 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.779s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:44 user nova-compute[72990]: DEBUG nova.objects.instance [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lazy-loading 'flavor' on Instance uuid ed1742b9-a19d-43f9-b39a-7257261f858c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:49:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-343d74d8-35c8-4e66-a884-ecfda5b579be tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 12.415s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knbmSeEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:49:45 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:49:45 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:49:45 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdb91ca-1360-4cc6-bc0d-39ebb10455a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:49:45 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bcec96-f9b2-4981-99ce-5fc1794c2959]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba] added
Aug 27 03:49:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1551ad26-56e1-443d-8af8-e1cd6237000e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[983495fb-7ef8-4187-9f0e-4dea2bb5ac82]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knbmSeEU {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knbmSeEU" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d878e691-b580-4937-a932-7446572f27e0]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'knbmSeEU'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f2f4c7-431c-42ab-88e3-568a8d061341]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6814448-7453-4895-8c43-1372af1ca3e1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:49:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:49:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2696bed1-94bc-4294-b80f-56190c0263bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260]
Aug 27 03:49:45 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260] successful.
Aug 27 03:49:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a23a633-026a-47d5-8b85-435e5b1f355e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[903c1edd-d2c0-4ebc-b6cf-99855bff264c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:49:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:49:45 user nova-compute[72990]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:49:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8032006-6d74-4bab-9c1f-b60414db4557]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:49:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knbmSeEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:49:46 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:49:46 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23633386163313466', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:49:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633386163313466', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:49:46 user nova-compute[72990]: DEBUG nova.objects.instance [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lazy-loading 'flavor' on Instance uuid 338682cb-8c70-49c3-b88c-362e96ec8fb1 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:49:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:49:46 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:49:46 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 03:49:46 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:49:46 user nova-compute[72990]:   <serial>0edcdf64-da71-43a8-b27d-b9cc7a7bbeba</serial>
Aug 27 03:49:46 user nova-compute[72990]: </disk>
Aug 27 03:49:46 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:49:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:49:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:49:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] No VIF found with MAC fa:16:3e:94:53:13, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:49:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3fe5d674-ff23-4897-b706-e2cecdab3b6d tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.805s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Stashing vm_state: active {{(pid=72990) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 27 03:49:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:49 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:49:49 user nova-compute[72990]: INFO nova.compute.claims [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Claim successful on node user
Aug 27 03:49:49 user nova-compute[72990]: INFO nova.compute.resource_tracker [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating resource usage from migration 0d10db52-1836-4c21-a2c3-94d5708f1566
Aug 27 03:49:49 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:49:49 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:49:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.511s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:49 user nova-compute[72990]: INFO nova.compute.manager [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Migrating
Aug 27 03:49:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:49:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:49:49 user nova-compute[72990]: INFO nova.compute.rpcapi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 27 03:49:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:49:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:49:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquired lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:49:49 user nova-compute[72990]: DEBUG nova.network.neutron [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:49:50 user nova-compute[72990]: DEBUG nova.network.neutron [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating instance_info_cache with network_info: [{"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:49:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Releasing lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:49:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Starting migrate_disk_and_power_off {{(pid=72990) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 27 03:49:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-eab17ca3-54f8-4f3e-8657-591b037180b9 req-5793f1b8-600d-4539-aada-793b1df71539 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-unplugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:49:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-eab17ca3-54f8-4f3e-8657-591b037180b9 req-5793f1b8-600d-4539-aada-793b1df71539 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-eab17ca3-54f8-4f3e-8657-591b037180b9 req-5793f1b8-600d-4539-aada-793b1df71539 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-eab17ca3-54f8-4f3e-8657-591b037180b9 req-5793f1b8-600d-4539-aada-793b1df71539 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-eab17ca3-54f8-4f3e-8657-591b037180b9 req-5793f1b8-600d-4539-aada-793b1df71539 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-unplugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:49:50 user nova-compute[72990]: WARNING nova.compute.manager [req-eab17ca3-54f8-4f3e-8657-591b037180b9 req-5793f1b8-600d-4539-aada-793b1df71539 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-unplugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state active and task_state resize_migrating.
Aug 27 03:49:51 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance destroyed successfully.
Aug 27 03:49:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2048756041',display_name='tempest-ServerActionsTestOtherB-server-2048756041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2048756041',id=18,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvV5/xdIrrMiR/5VLCxhM3KKboDXXvobrXZoxgpQUAOozywbLJ2xsxdUcEhJo7m/5kpTKUpySOn2yAwFLCYDLgNxiCX1IdtXhqxCfcecMFLg6qxM0T/ZTj+kDi4FnruVQ==',key_name='tempest-keypair-1100770948',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:46:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3efa88907cc54e01abeabdfb040a6d23',ramdisk_id='',reservation_id='r-v5k469oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-862895181',owner_user_name='tempest-ServerActionsTestOtherB-862895181-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f71b8c6ad2624149b3760b97ab8a9e4a',uuid=338682cb-8c70-49c3-b88c-362e96ec8fb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-207012819-network", "vif_mac": "fa:16:3e:94:53:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converting VIF {"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-207012819-network", "vif_mac": "fa:16:3e:94:53:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_vif [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09f159e5-8c, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:49:51 user nova-compute[72990]: INFO os_vif [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c')
Aug 27 03:49:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knbmSeEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:49:51 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[499e43d4-6f8a-4f2b-809b-7f1b6439ab4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9ff97e-a064-4e6e-a4eb-fb694a737a26]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:51 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:51 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:51 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:49:51 user nova-compute[72990]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:49:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:49:51 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:49:51 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:49:51 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:49:51 user nova-compute[72990]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:49:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44a0670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe2e9d9-4f59-4b68-9666-628b1830f336]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[49128740-d853-45a5-a93d-bcdd354e8862]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f66bac-be13-4c1f-94f0-7f643f9a60e6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[037af134-b2e9-4a4b-aa22-178c833be41e]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f84e36-f2c3-43f0-8893-89a138e7557a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ce6690-c3f7-4ad9-ae8c-bff7ef6c679a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260]
Aug 27 03:49:51 user nova-compute[72990]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260] successful.
Aug 27 03:49:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5765b5-adb5-4a1e-8598-e666428ae42a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] <== disconnect_volume: return (328ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:49:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1_resize/disk /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CMD "cp -r /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1_resize/disk /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk" returned: 0 in 0.275s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1_resize/disk.info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk.info {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CMD "cp -r /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1_resize/disk.info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk.info" returned: 0 in 0.040s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:52 user nova-compute[72990]: DEBUG nova.compute.manager [req-cd267598-0929-4b82-b2e1-0586f926edb4 req-b2d8d7c3-866e-4fab-a4e0-de30f20e7f7d service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:49:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cd267598-0929-4b82-b2e1-0586f926edb4 req-b2d8d7c3-866e-4fab-a4e0-de30f20e7f7d service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cd267598-0929-4b82-b2e1-0586f926edb4 req-b2d8d7c3-866e-4fab-a4e0-de30f20e7f7d service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cd267598-0929-4b82-b2e1-0586f926edb4 req-b2d8d7c3-866e-4fab-a4e0-de30f20e7f7d service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:52 user nova-compute[72990]: DEBUG nova.compute.manager [req-cd267598-0929-4b82-b2e1-0586f926edb4 req-b2d8d7c3-866e-4fab-a4e0-de30f20e7f7d service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:49:52 user nova-compute[72990]: WARNING nova.compute.manager [req-cd267598-0929-4b82-b2e1-0586f926edb4 req-b2d8d7c3-866e-4fab-a4e0-de30f20e7f7d service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state active and task_state resize_migrating.
Aug 27 03:49:53 user nova-compute[72990]: DEBUG nova.network.neutron [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Port 09f159e5-8c35-4fa2-a2e9-873634e6a084 binding to destination host user is already ACTIVE {{(pid=72990) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 03:49:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:49:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:49:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:49:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:49:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquired lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:49:53 user nova-compute[72990]: DEBUG nova.network.neutron [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG nova.network.neutron [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating instance_info_cache with network_info: [{"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Releasing lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG os_brick.utils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f897e81-4bfe-4a15-b704-2cb7ff003692]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a89be1-5920-42f8-bd1a-5127c502243d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91f26d8-fd04-4361-8fbd-32ddba57bc70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a5a1d5-10c4-4560-9081-8e7a8be1f3e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:49:54 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:49:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0a8f1c-c6e5-4caa-9c4d-d51484e53221]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:49:54 user nova-compute[72990]: DEBUG os_brick.utils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:49:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:50:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:06 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108191.1556482, 338682cb-8c70-49c3-b88c-362e96ec8fb1 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:50:06 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] VM Stopped (Lifecycle Event)
Aug 27 03:50:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a64a7447-e41a-42a3-8f66-9869f742b270 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:50:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a64a7447-e41a-42a3-8f66-9869f742b270 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:50:06 user nova-compute[72990]: INFO nova.compute.manager [None req-a64a7447-e41a-42a3-8f66-9869f742b270 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 03:50:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Starting finish_migration {{(pid=72990) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance directory exists: not creating {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 03:50:07 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Creating image(s)
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.180s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Checking if we can resize image /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk. size=21474836480 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk 21474836480 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk 21474836480" returned: 0 in 0.045s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Ensure instance console log exists: /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Start _get_guest_xml network_info=[{"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-207012819-network", "vif_mac": "fa:16:3e:94:53:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'eef6485a-0306-4f06-92e3-c5fe756be694', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knbmSeEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '338682cb-8c70-49c3-b88c-362e96ec8fb1', 'attached_at': '2023-08-27T03:50:07.000000', 'detached_at': '', 'volume_id': '0edcdf64-da71-43a8-b27d-b9cc7a7bbeba', 'serial': '0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:50:07 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:50:07 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knbmSeEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:50:07 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:50:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:50:07 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:50:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:50:07 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d4264a-9745-4489-9931-846789edf7f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:50:07 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6729f0a6-e272-4c4f-acc9-27a30f59dec6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba] added
Aug 27 03:50:08 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[282bbd9a-b7d4-4bc6-bc9a-0731d423fc10]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5e61ca-e919-4ca6-bac3-3fef0466ff2b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knbmSeEU {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knbmSeEU" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa3bee3-b5b3-4e7c-b697-29e2a311c37a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'knbmSeEU'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7829ec1-f587-44ad-84fc-56dc6a37980b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b19a3e1-18fe-41f1-b69d-a5414743b7c1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:50:08 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:50:08 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed69791-4821-44bf-838e-9430d9af94c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260]
Aug 27 03:50:08 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260] successful.
Aug 27 03:50:08 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5f63e7-5752-456b-b8df-e8fd4e2d9317]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e42923-f064-451e-9518-511a073215e3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:50:08 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:50:08 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:50:08 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec429b3b-70dd-41c1-b180-f34539e1772a]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:50:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knbmSeEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23633386163313466', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633386163313466', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2048756041',display_name='tempest-ServerActionsTestOtherB-server-2048756041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2048756041',id=18,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvV5/xdIrrMiR/5VLCxhM3KKboDXXvobrXZoxgpQUAOozywbLJ2xsxdUcEhJo7m/5kpTKUpySOn2yAwFLCYDLgNxiCX1IdtXhqxCfcecMFLg6qxM0T/ZTj+kDi4FnruVQ==',key_name='tempest-keypair-1100770948',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:46:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3efa88907cc54e01abeabdfb040a6d23',ramdisk_id='',reservation_id='r-v5k469oe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-862895181',owner_user_name='tempest-ServerActionsTestOtherB-862895181-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f71b8c6ad2624149b3760b97ab8a9e4a',uuid=338682cb-8c70-49c3-b88c-362e96ec8fb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-207012819-network", "vif_mac": "fa:16:3e:94:53:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converting VIF {"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-207012819-network", "vif_mac": "fa:16:3e:94:53:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:50:09 user nova-compute[72990]:   <uuid>338682cb-8c70-49c3-b88c-362e96ec8fb1</uuid>
Aug 27 03:50:09 user nova-compute[72990]:   <name>instance-00000012</name>
Aug 27 03:50:09 user nova-compute[72990]:   <memory>2097152</memory>
Aug 27 03:50:09 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:50:09 user nova-compute[72990]:   <metadata>
Aug 27 03:50:09 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:50:09 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:50:09 user nova-compute[72990]:       <nova:name>tempest-ServerActionsTestOtherB-server-2048756041</nova:name>
Aug 27 03:50:09 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:50:07</nova:creationTime>
Aug 27 03:50:09 user nova-compute[72990]:       <nova:flavor name="m1.small">
Aug 27 03:50:09 user nova-compute[72990]:         <nova:memory>2048</nova:memory>
Aug 27 03:50:09 user nova-compute[72990]:         <nova:disk>20</nova:disk>
Aug 27 03:50:09 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:50:09 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:50:09 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:50:09 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:50:09 user nova-compute[72990]:       <nova:owner>
Aug 27 03:50:09 user nova-compute[72990]:         <nova:user uuid="f71b8c6ad2624149b3760b97ab8a9e4a">tempest-ServerActionsTestOtherB-862895181-project-member</nova:user>
Aug 27 03:50:09 user nova-compute[72990]:         <nova:project uuid="3efa88907cc54e01abeabdfb040a6d23">tempest-ServerActionsTestOtherB-862895181</nova:project>
Aug 27 03:50:09 user nova-compute[72990]:       </nova:owner>
Aug 27 03:50:09 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:50:09 user nova-compute[72990]:       <nova:ports>
Aug 27 03:50:09 user nova-compute[72990]:         <nova:port uuid="09f159e5-8c35-4fa2-a2e9-873634e6a084">
Aug 27 03:50:09 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 03:50:09 user nova-compute[72990]:         </nova:port>
Aug 27 03:50:09 user nova-compute[72990]:       </nova:ports>
Aug 27 03:50:09 user nova-compute[72990]:     </nova:instance>
Aug 27 03:50:09 user nova-compute[72990]:   </metadata>
Aug 27 03:50:09 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:50:09 user nova-compute[72990]:     <system>
Aug 27 03:50:09 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:50:09 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:50:09 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:50:09 user nova-compute[72990]:       <entry name="serial">338682cb-8c70-49c3-b88c-362e96ec8fb1</entry>
Aug 27 03:50:09 user nova-compute[72990]:       <entry name="uuid">338682cb-8c70-49c3-b88c-362e96ec8fb1</entry>
Aug 27 03:50:09 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:50:09 user nova-compute[72990]:     </system>
Aug 27 03:50:09 user nova-compute[72990]:   </sysinfo>
Aug 27 03:50:09 user nova-compute[72990]:   <os>
Aug 27 03:50:09 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:50:09 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:50:09 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:50:09 user nova-compute[72990]:   </os>
Aug 27 03:50:09 user nova-compute[72990]:   <features>
Aug 27 03:50:09 user nova-compute[72990]:     <acpi/>
Aug 27 03:50:09 user nova-compute[72990]:     <apic/>
Aug 27 03:50:09 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:50:09 user nova-compute[72990]:   </features>
Aug 27 03:50:09 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:50:09 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:50:09 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:50:09 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:50:09 user nova-compute[72990]:   </clock>
Aug 27 03:50:09 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:50:09 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:50:09 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:50:09 user nova-compute[72990]:   </cpu>
Aug 27 03:50:09 user nova-compute[72990]:   <devices>
Aug 27 03:50:09 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:50:09 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:50:09 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk"/>
Aug 27 03:50:09 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:50:09 user nova-compute[72990]:     </disk>
Aug 27 03:50:09 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:50:09 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:50:09 user nova-compute[72990]:       <source dev="/dev/sdc"/>
Aug 27 03:50:09 user nova-compute[72990]:       <target dev="vdb" bus="virtio"/>
Aug 27 03:50:09 user nova-compute[72990]:       <serial>0edcdf64-da71-43a8-b27d-b9cc7a7bbeba</serial>
Aug 27 03:50:09 user nova-compute[72990]:     </disk>
Aug 27 03:50:09 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:50:09 user nova-compute[72990]:       <mac address="fa:16:3e:94:53:13"/>
Aug 27 03:50:09 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:50:09 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:50:09 user nova-compute[72990]:       <target dev="tap09f159e5-8c"/>
Aug 27 03:50:09 user nova-compute[72990]:     </interface>
Aug 27 03:50:09 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:50:09 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/console.log" append="off"/>
Aug 27 03:50:09 user nova-compute[72990]:     </serial>
Aug 27 03:50:09 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:50:09 user nova-compute[72990]:     <video>
Aug 27 03:50:09 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:50:09 user nova-compute[72990]:     </video>
Aug 27 03:50:09 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:50:09 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:50:09 user nova-compute[72990]:     </rng>
Aug 27 03:50:09 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:50:09 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:50:09 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:50:09 user nova-compute[72990]:     </memballoon>
Aug 27 03:50:09 user nova-compute[72990]:   </devices>
Aug 27 03:50:09 user nova-compute[72990]: </domain>
Aug 27 03:50:09 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2048756041',display_name='tempest-ServerActionsTestOtherB-server-2048756041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2048756041',id=18,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvV5/xdIrrMiR/5VLCxhM3KKboDXXvobrXZoxgpQUAOozywbLJ2xsxdUcEhJo7m/5kpTKUpySOn2yAwFLCYDLgNxiCX1IdtXhqxCfcecMFLg6qxM0T/ZTj+kDi4FnruVQ==',key_name='tempest-keypair-1100770948',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:46:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3efa88907cc54e01abeabdfb040a6d23',ramdisk_id='',reservation_id='r-v5k469oe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-862895181',owner_user_name='tempest-ServerActionsTestOtherB-862895181-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f71b8c6ad2624149b3760b97ab8a9e4a',uuid=338682cb-8c70-49c3-b88c-362e96ec8fb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-207012819-network", "vif_mac": "fa:16:3e:94:53:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converting VIF {"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-207012819-network", "vif_mac": "fa:16:3e:94:53:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG os_vif [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09f159e5-8c, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09f159e5-8c, col_values=(('external_ids', {'iface-id': '09f159e5-8c35-4fa2-a2e9-873634e6a084', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:53:13', 'vm-uuid': '338682cb-8c70-49c3-b88c-362e96ec8fb1'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:09 user nova-compute[72990]: INFO os_vif [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c')
Aug 27 03:50:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:50:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] No VIF found with MAC fa:16:3e:94:53:13, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:50:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-ed58f6bf-831c-486d-9075-defa80dfa80f req-baaae1f0-d572-4a48-85b9-e1f7c5a9004f service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ed58f6bf-831c-486d-9075-defa80dfa80f req-baaae1f0-d572-4a48-85b9-e1f7c5a9004f service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ed58f6bf-831c-486d-9075-defa80dfa80f req-baaae1f0-d572-4a48-85b9-e1f7c5a9004f service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ed58f6bf-831c-486d-9075-defa80dfa80f req-baaae1f0-d572-4a48-85b9-e1f7c5a9004f service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-ed58f6bf-831c-486d-9075-defa80dfa80f req-baaae1f0-d572-4a48-85b9-e1f7c5a9004f service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:50:11 user nova-compute[72990]: WARNING nova.compute.manager [req-ed58f6bf-831c-486d-9075-defa80dfa80f req-baaae1f0-d572-4a48-85b9-e1f7c5a9004f service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state active and task_state resize_finish.
Aug 27 03:50:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:13 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108213.0540664, 338682cb-8c70-49c3-b88c-362e96ec8fb1 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:50:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] VM Resumed (Lifecycle Event)
Aug 27 03:50:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:50:13 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance running successfully.
Aug 27 03:50:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Failed to set time: agent not configured {{(pid=72990) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 27 03:50:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e62a93c9-e9f6-47f2-9018-aaad0b28db2f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] finish_migration finished successfully. {{(pid=72990) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 27 03:50:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:50:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:50:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-b5a9974e-7c3f-4a84-a787-0928db505231 req-535fcea0-8a2b-4216-bbde-1e699b621274 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b5a9974e-7c3f-4a84-a787-0928db505231 req-535fcea0-8a2b-4216-bbde-1e699b621274 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b5a9974e-7c3f-4a84-a787-0928db505231 req-535fcea0-8a2b-4216-bbde-1e699b621274 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b5a9974e-7c3f-4a84-a787-0928db505231 req-535fcea0-8a2b-4216-bbde-1e699b621274 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-b5a9974e-7c3f-4a84-a787-0928db505231 req-535fcea0-8a2b-4216-bbde-1e699b621274 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:50:13 user nova-compute[72990]: WARNING nova.compute.manager [req-b5a9974e-7c3f-4a84-a787-0928db505231 req-535fcea0-8a2b-4216-bbde-1e699b621274 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state active and task_state resize_finish.
Aug 27 03:50:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 03:50:13 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108213.055171, 338682cb-8c70-49c3-b88c-362e96ec8fb1 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:50:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] VM Started (Lifecycle Event)
Aug 27 03:50:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:50:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:50:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 03:50:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:20 user nova-compute[72990]: INFO nova.compute.manager [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Detaching volume 43bb8c4c-9749-468d-8371-1d1818fa1f66
Aug 27 03:50:20 user nova-compute[72990]: INFO nova.virt.block_device [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Attempting to driver detach volume 43bb8c4c-9749-468d-8371-1d1818fa1f66 from mountpoint /dev/vdc
Aug 27 03:50:20 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Attempting to detach device vdc from instance 1e81de88-259e-4124-8e2c-cafd310a9b42 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:50:20 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:50:20 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:50:20 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:50:20 user nova-compute[72990]:   <target dev="vdc" bus="virtio"/>
Aug 27 03:50:20 user nova-compute[72990]:   <serial>43bb8c4c-9749-468d-8371-1d1818fa1f66</serial>
Aug 27 03:50:20 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 03:50:20 user nova-compute[72990]: </disk>
Aug 27 03:50:20 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:50:20 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Successfully detached device vdc from instance 1e81de88-259e-4124-8e2c-cafd310a9b42 from the persistent domain config.
Aug 27 03:50:20 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1e81de88-259e-4124-8e2c-cafd310a9b42 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:50:20 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:50:20 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:50:20 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:50:20 user nova-compute[72990]:   <target dev="vdc" bus="virtio"/>
Aug 27 03:50:20 user nova-compute[72990]:   <serial>43bb8c4c-9749-468d-8371-1d1818fa1f66</serial>
Aug 27 03:50:20 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 03:50:20 user nova-compute[72990]: </disk>
Aug 27 03:50:20 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693108221.306574, 1e81de88-259e-4124-8e2c-cafd310a9b42 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:50:21 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Successfully detached device vdc from instance 1e81de88-259e-4124-8e2c-cafd310a9b42 from the live domain config.
Aug 27 03:50:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZbLnxdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:50:21 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a320ed5-b9d7-4087-95e5-333f82c3dc11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffee16a-0156-495d-aa3a-ac82f19d9ff6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:50:21 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:50:21 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:50:21 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:50:21 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:50:21 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:50:21 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:50:21 user nova-compute[72990]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 (non-flash)
Aug 27 03:50:21 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:50:21 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:50:21 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4430b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43d9cb5-aa99-46f2-8f7d-3bfa40555534]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdec19e6-86b9-411a-b2e2-5298cb5709f8]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bf9066-74d4-4aa1-b4c6-381b7a1e8536]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bdbee7-9835-4e7a-906c-63ab72350e0d]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c240f9-ff84-44d1-a4c4-2c205ecc06f9]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.156s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab410c0c-0928-407d-947b-50764ba1c46e]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66, portal: 172.16.0.220,3260]
Aug 27 03:50:21 user nova-compute[72990]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66, portal: 172.16.0.220,3260] successful.
Aug 27 03:50:21 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43bb8c4c-9749-468d-8371-1d1818fa1f66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac5498a-da50-48e7-a474-348aff9be49a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] <== disconnect_volume: return (385ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:50:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:50:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:22 user nova-compute[72990]: DEBUG nova.objects.instance [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'flavor' on Instance uuid 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:50:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-be83ad67-b365-4627-b81f-50adac6221a6 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.780s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:22 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:50:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:22 user nova-compute[72990]: INFO nova.compute.manager [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Terminating instance
Aug 27 03:50:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:50:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-ae4414c2-f39e-479a-9d7b-823c1d165a3c req-918831fa-fffb-4ac5-92fb-223afd6a0b05 service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received event network-vif-unplugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ae4414c2-f39e-479a-9d7b-823c1d165a3c req-918831fa-fffb-4ac5-92fb-223afd6a0b05 service nova] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ae4414c2-f39e-479a-9d7b-823c1d165a3c req-918831fa-fffb-4ac5-92fb-223afd6a0b05 service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ae4414c2-f39e-479a-9d7b-823c1d165a3c req-918831fa-fffb-4ac5-92fb-223afd6a0b05 service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-ae4414c2-f39e-479a-9d7b-823c1d165a3c req-918831fa-fffb-4ac5-92fb-223afd6a0b05 service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] No waiting events found dispatching network-vif-unplugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-ae4414c2-f39e-479a-9d7b-823c1d165a3c req-918831fa-fffb-4ac5-92fb-223afd6a0b05 service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received event network-vif-unplugged-9e575e22-6f02-488a-8e18-e9675c3b96ab for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:50:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Instance destroyed successfully.
Aug 27 03:50:23 user nova-compute[72990]: DEBUG nova.objects.instance [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lazy-loading 'resources' on Instance uuid ed1742b9-a19d-43f9-b39a-7257261f858c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1281588218',display_name='tempest-ServerActionsTestOtherA-server-1454386449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1281588218',id=15,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlsSoCaAZImkchManu4IUvMInuwySyWjvM2BnRYj8TwOTjrbfVvrIsy0gRdvaW2QKnHoTyZTaBdUMPbi7bSwOX2IM8E9MHYP+B14NgLPuI0yP5eDhmXA6u6V49C6mCNCw==',key_name='tempest-keypair-67383262',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:46:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-07ekxxya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=ed1742b9-a19d-43f9-b39a-7257261f858c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "address": "fa:16:3e:07:eb:d3", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e575e22-6f", "ovs_interfaceid": "9e575e22-6f02-488a-8e18-e9675c3b96ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG os_vif [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e575e22-6f, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:23 user nova-compute[72990]: INFO os_vif [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=9e575e22-6f02-488a-8e18-e9675c3b96ab,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e575e22-6f')
Aug 27 03:50:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Deleting instance files /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c_del
Aug 27 03:50:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Deletion of /opt/stack/data/nova/instances/ed1742b9-a19d-43f9-b39a-7257261f858c_del complete
Aug 27 03:50:23 user nova-compute[72990]: INFO nova.compute.manager [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 27 03:50:23 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:50:23 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:50:24 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:50:24 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Took 1.10 seconds to deallocate network for instance.
Aug 27 03:50:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-debe56ee-915b-41ef-9693-0743cbfae436 req-3e2a6e23-5af3-4d8d-b016-e6133f6677b1 service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received event network-vif-deleted-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:25 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:50:25 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:50:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:25 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Deleted allocations for instance ed1742b9-a19d-43f9-b39a-7257261f858c
Aug 27 03:50:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-9afcf7fc-08d3-4852-8596-e1c9e8f0753a req-12bb102a-1865-4c78-9d69-f11bb577ec0c service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received event network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9afcf7fc-08d3-4852-8596-e1c9e8f0753a req-12bb102a-1865-4c78-9d69-f11bb577ec0c service nova] Acquiring lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9afcf7fc-08d3-4852-8596-e1c9e8f0753a req-12bb102a-1865-4c78-9d69-f11bb577ec0c service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9afcf7fc-08d3-4852-8596-e1c9e8f0753a req-12bb102a-1865-4c78-9d69-f11bb577ec0c service nova] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-9afcf7fc-08d3-4852-8596-e1c9e8f0753a req-12bb102a-1865-4c78-9d69-f11bb577ec0c service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] No waiting events found dispatching network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:50:25 user nova-compute[72990]: WARNING nova.compute.manager [req-9afcf7fc-08d3-4852-8596-e1c9e8f0753a req-12bb102a-1865-4c78-9d69-f11bb577ec0c service nova] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Received unexpected event network-vif-plugged-9e575e22-6f02-488a-8e18-e9675c3b96ab for instance with vm_state deleted and task_state None.
Aug 27 03:50:25 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:50:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-081bf7f8-83af-4868-8764-02e5e5ebb33e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "ed1742b9-a19d-43f9-b39a-7257261f858c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:50:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:50:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:50:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:27 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:50:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "9052a337-efb8-4a79-95c1-685d22966cec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "9052a337-efb8-4a79-95c1-685d22966cec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "9052a337-efb8-4a79-95c1-685d22966cec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "9052a337-efb8-4a79-95c1-685d22966cec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "9052a337-efb8-4a79-95c1-685d22966cec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:28 user nova-compute[72990]: INFO nova.compute.manager [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Terminating instance
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-973915e7-ac89-4d3a-bb0c-a3159d2a05ea req-342342d3-1dac-4b71-8388-a5f1cdf279dd service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Received event network-vif-unplugged-ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-973915e7-ac89-4d3a-bb0c-a3159d2a05ea req-342342d3-1dac-4b71-8388-a5f1cdf279dd service nova] Acquiring lock "9052a337-efb8-4a79-95c1-685d22966cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-973915e7-ac89-4d3a-bb0c-a3159d2a05ea req-342342d3-1dac-4b71-8388-a5f1cdf279dd service nova] Lock "9052a337-efb8-4a79-95c1-685d22966cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-973915e7-ac89-4d3a-bb0c-a3159d2a05ea req-342342d3-1dac-4b71-8388-a5f1cdf279dd service nova] Lock "9052a337-efb8-4a79-95c1-685d22966cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-973915e7-ac89-4d3a-bb0c-a3159d2a05ea req-342342d3-1dac-4b71-8388-a5f1cdf279dd service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] No waiting events found dispatching network-vif-unplugged-ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-973915e7-ac89-4d3a-bb0c-a3159d2a05ea req-342342d3-1dac-4b71-8388-a5f1cdf279dd service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Received event network-vif-unplugged-ed0518e1-05ee-4dde-b386-b83977c4872c for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:28 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Instance destroyed successfully.
Aug 27 03:50:28 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'resources' on Instance uuid 9052a337-efb8-4a79-95c1-685d22966cec {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1844801511',display_name='tempest-AttachVolumeNegativeTest-server-1844801511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1844801511',id=19,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtzJe4pwiGtzii4pfCo8neGv61D2bhbkP+CCXV6bq46JzYeYLsAOFCkle3MKvfFwhQ1DdIBsczmoD6qUTsDkAVxj/p9u8fy/qrF5qwOjMvO6z2n6Fa4Sbb7D7VO4TQpaA==',key_name='tempest-keypair-2125464292',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d007a65dbbce40729d2d7a25561a4f91',ramdisk_id='',reservation_id='r-vel7i9p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-945598863',owner_user_name='tempest-AttachVolumeNegativeTest-945598863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7d2fc4d4204ad38d0d11376de45bd6',uuid=9052a337-efb8-4a79-95c1-685d22966cec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed0518e1-05ee-4dde-b386-b83977c4872c", "address": "fa:16:3e:c9:9e:a3", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0518e1-05", "ovs_interfaceid": "ed0518e1-05ee-4dde-b386-b83977c4872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converting VIF {"id": "ed0518e1-05ee-4dde-b386-b83977c4872c", "address": "fa:16:3e:c9:9e:a3", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0518e1-05", "ovs_interfaceid": "ed0518e1-05ee-4dde-b386-b83977c4872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:9e:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed0518e1-05ee-4dde-b386-b83977c4872c,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0518e1-05') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG os_vif [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:9e:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed0518e1-05ee-4dde-b386-b83977c4872c,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0518e1-05') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped0518e1-05, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:50:28 user nova-compute[72990]: INFO os_vif [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:9e:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed0518e1-05ee-4dde-b386-b83977c4872c,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0518e1-05')
Aug 27 03:50:28 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Deleting instance files /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec_del
Aug 27 03:50:28 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Deletion of /opt/stack/data/nova/instances/9052a337-efb8-4a79-95c1-685d22966cec_del complete
Aug 27 03:50:29 user nova-compute[72990]: INFO nova.compute.manager [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 27 03:50:29 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:50:29 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:50:29 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:50:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:50:29 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Error from libvirt while getting description of instance-00000013: [Error Code 42] Domain not found: no domain with matching uuid '9052a337-efb8-4a79-95c1-685d22966cec' (instance-00000013): libvirt.libvirtError: Domain not found: no domain with matching uuid '9052a337-efb8-4a79-95c1-685d22966cec' (instance-00000013)
Aug 27 03:50:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-df5b36da-768e-4c51-b913-5c9c3c91a706 req-bcc43d3e-dd60-4da2-91c0-09a3c595dfec service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Received event network-vif-deleted-ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:30 user nova-compute[72990]: INFO nova.compute.manager [req-df5b36da-768e-4c51-b913-5c9c3c91a706 req-bcc43d3e-dd60-4da2-91c0-09a3c595dfec service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Neutron deleted interface ed0518e1-05ee-4dde-b386-b83977c4872c; detaching it from the instance and deleting it from the info cache
Aug 27 03:50:30 user nova-compute[72990]: DEBUG nova.network.neutron [req-df5b36da-768e-4c51-b913-5c9c3c91a706 req-bcc43d3e-dd60-4da2-91c0-09a3c595dfec service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:50:30 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Took 1.14 seconds to deallocate network for instance.
Aug 27 03:50:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-df5b36da-768e-4c51-b913-5c9c3c91a706 req-bcc43d3e-dd60-4da2-91c0-09a3c595dfec service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Detach interface failed, port_id=ed0518e1-05ee-4dde-b386-b83977c4872c, reason: Instance 9052a337-efb8-4a79-95c1-685d22966cec could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-aa1c4b89-39d0-456c-a4ee-5f158e1a0ff1 req-cf94ed5f-14e9-4888-b644-ddefa6b00dfc service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Received event network-vif-plugged-ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aa1c4b89-39d0-456c-a4ee-5f158e1a0ff1 req-cf94ed5f-14e9-4888-b644-ddefa6b00dfc service nova] Acquiring lock "9052a337-efb8-4a79-95c1-685d22966cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aa1c4b89-39d0-456c-a4ee-5f158e1a0ff1 req-cf94ed5f-14e9-4888-b644-ddefa6b00dfc service nova] Lock "9052a337-efb8-4a79-95c1-685d22966cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aa1c4b89-39d0-456c-a4ee-5f158e1a0ff1 req-cf94ed5f-14e9-4888-b644-ddefa6b00dfc service nova] Lock "9052a337-efb8-4a79-95c1-685d22966cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-aa1c4b89-39d0-456c-a4ee-5f158e1a0ff1 req-cf94ed5f-14e9-4888-b644-ddefa6b00dfc service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] No waiting events found dispatching network-vif-plugged-ed0518e1-05ee-4dde-b386-b83977c4872c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:50:30 user nova-compute[72990]: WARNING nova.compute.manager [req-aa1c4b89-39d0-456c-a4ee-5f158e1a0ff1 req-cf94ed5f-14e9-4888-b644-ddefa6b00dfc service nova] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Received unexpected event network-vif-plugged-ed0518e1-05ee-4dde-b386-b83977c4872c for instance with vm_state deleted and task_state None.
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.653s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:30 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Deleted allocations for instance 9052a337-efb8-4a79-95c1-685d22966cec
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "interface-f2c7f4ed-0c08-4bd8-8386-3830b33a2564-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "interface-f2c7f4ed-0c08-4bd8-8386-3830b33a2564-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG nova.objects.instance [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lazy-loading 'flavor' on Instance uuid f2c7f4ed-0c08-4bd8-8386-3830b33a2564 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9834f89f-2997-48d0-b113-8263bd043e16 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "9052a337-efb8-4a79-95c1-685d22966cec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.038s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG nova.objects.instance [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lazy-loading 'pci_requests' on Instance uuid f2c7f4ed-0c08-4bd8-8386-3830b33a2564 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG nova.objects.base [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Object Instance<f2c7f4ed-0c08-4bd8-8386-3830b33a2564> lazy-loaded attributes: flavor,pci_requests {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG nova.network.neutron [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG nova.policy [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2908a9f30c314839abec26c49028f756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9300e35c8184397bcb840a58209d97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Successfully created port: 98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-0f82781f-e92f-465f-966c-71410b0ce52f req-49c5effa-2cc1-4637-aabb-ed9366f6c1d0 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-changed-84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-0f82781f-e92f-465f-966c-71410b0ce52f req-49c5effa-2cc1-4637-aabb-ed9366f6c1d0 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Refreshing instance network info cache due to event network-changed-84ceee62-cd25-4a7f-b1e5-4e327e56d019. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0f82781f-e92f-465f-966c-71410b0ce52f req-49c5effa-2cc1-4637-aabb-ed9366f6c1d0 service nova] Acquiring lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0f82781f-e92f-465f-966c-71410b0ce52f req-49c5effa-2cc1-4637-aabb-ed9366f6c1d0 service nova] Acquired lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-0f82781f-e92f-465f-966c-71410b0ce52f req-49c5effa-2cc1-4637-aabb-ed9366f6c1d0 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Refreshing network info cache for port 84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:50:32 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:50:32 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:50:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=6978MB free_disk=25.085975646972656GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Applying migration context for instance 338682cb-8c70-49c3-b88c-362e96ec8fb1 as it has an incoming, in-progress migration 0d10db52-1836-4c21-a2c3-94d5708f1566. Migration status is finished {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 03:50:32 user nova-compute[72990]: INFO nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating resource usage from migration 0d10db52-1836-4c21-a2c3-94d5708f1566
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 1e81de88-259e-4124-8e2c-cafd310a9b42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 6a44010b-9a96-4343-a35c-1f212d21e47b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 15a88698-88d1-4c6b-9e40-98b618978a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance c540f8c5-8827-4991-bee7-e2fce0c2d978 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Migration 0d10db52-1836-4c21-a2c3-94d5708f1566 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 338682cb-8c70-49c3-b88c-362e96ec8fb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG nova.network.neutron [req-0f82781f-e92f-465f-966c-71410b0ce52f req-49c5effa-2cc1-4637-aabb-ed9366f6c1d0 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updated VIF entry in instance network info cache for port 84ceee62-cd25-4a7f-b1e5-4e327e56d019. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG nova.network.neutron [req-0f82781f-e92f-465f-966c-71410b0ce52f req-49c5effa-2cc1-4637-aabb-ed9366f6c1d0 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updating instance_info_cache with network_info: [{"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0f82781f-e92f-465f-966c-71410b0ce52f req-49c5effa-2cc1-4637-aabb-ed9366f6c1d0 service nova] Releasing lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG nova.network.neutron [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Successfully updated port: 98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquired lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG nova.network.neutron [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-b82ee76d-c3e4-444d-a56c-419f5d7c1708 req-32d30167-bd38-44be-8e51-62ee6d5c5f89 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-changed-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-b82ee76d-c3e4-444d-a56c-419f5d7c1708 req-32d30167-bd38-44be-8e51-62ee6d5c5f89 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Refreshing instance network info cache due to event network-changed-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b82ee76d-c3e4-444d-a56c-419f5d7c1708 req-32d30167-bd38-44be-8e51-62ee6d5c5f89 service nova] Acquiring lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:50:34 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Updating instance_info_cache with network_info: [{"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.network.neutron [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updating instance_info_cache with network_info: [{"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Releasing lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b82ee76d-c3e4-444d-a56c-419f5d7c1708 req-32d30167-bd38-44be-8e51-62ee6d5c5f89 service nova] Acquired lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.network.neutron [req-b82ee76d-c3e4-444d-a56c-419f5d7c1708 req-32d30167-bd38-44be-8e51-62ee6d5c5f89 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Refreshing network info cache for port 98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-212175205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-212175205',id=20,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp5iBc6mdgWaggg8GPI462w6II2N5RXXCb7cdBNB2ye3sojol5LvoVHu+BZkBNjSsdZnceTMdoaxLj46rXSeiRp/G2O9qGXI+h1ydtY+K0cIAqh7rlTCqTWWaEgArwZNw==',key_name='tempest-keypair-1954013112',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9300e35c8184397bcb840a58209d97c',ramdisk_id='',reservation_id='r-w1471yyo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2065968082',owner_user_name='tempest-TaggedAttachmentsTest-2065968082-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2908a9f30c314839abec26c49028f756',uuid=f2c7f4ed-0c08-4bd8-8386-3830b33a2564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converting VIF {"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=98f21bd1-d0d9-4e27-8ee4-d3b9784974b4,network=Network(381f95fd-80cf-4633-a1b8-da03f10eb242),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f21bd1-d0') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG os_vif [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=98f21bd1-d0d9-4e27-8ee4-d3b9784974b4,network=Network(381f95fd-80cf-4633-a1b8-da03f10eb242),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f21bd1-d0') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98f21bd1-d0, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98f21bd1-d0, col_values=(('external_ids', {'iface-id': '98f21bd1-d0d9-4e27-8ee4-d3b9784974b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:ec:9f', 'vm-uuid': 'f2c7f4ed-0c08-4bd8-8386-3830b33a2564'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:35 user nova-compute[72990]: INFO os_vif [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=98f21bd1-d0d9-4e27-8ee4-d3b9784974b4,network=Network(381f95fd-80cf-4633-a1b8-da03f10eb242),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f21bd1-d0')
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-212175205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-212175205',id=20,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp5iBc6mdgWaggg8GPI462w6II2N5RXXCb7cdBNB2ye3sojol5LvoVHu+BZkBNjSsdZnceTMdoaxLj46rXSeiRp/G2O9qGXI+h1ydtY+K0cIAqh7rlTCqTWWaEgArwZNw==',key_name='tempest-keypair-1954013112',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9300e35c8184397bcb840a58209d97c',ramdisk_id='',reservation_id='r-w1471yyo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2065968082',owner_user_name='tempest-TaggedAttachmentsTest-2065968082-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2908a9f30c314839abec26c49028f756',uuid=f2c7f4ed-0c08-4bd8-8386-3830b33a2564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converting VIF {"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=98f21bd1-d0d9-4e27-8ee4-d3b9784974b4,network=Network(381f95fd-80cf-4633-a1b8-da03f10eb242),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f21bd1-d0') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] attach device xml: <interface type="ethernet">
Aug 27 03:50:35 user nova-compute[72990]:   <mac address="fa:16:3e:01:ec:9f"/>
Aug 27 03:50:35 user nova-compute[72990]:   <model type="virtio"/>
Aug 27 03:50:35 user nova-compute[72990]:   <mtu size="1442"/>
Aug 27 03:50:35 user nova-compute[72990]:   <target dev="tap98f21bd1-d0"/>
Aug 27 03:50:35 user nova-compute[72990]: </interface>
Aug 27 03:50:35 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.compute.manager [req-3f7e8dbe-c91d-4ac3-96c5-85cabeb0ec7c req-c38dbfb8-b9f4-4596-a63e-233be3073e4a service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-vif-plugged-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3f7e8dbe-c91d-4ac3-96c5-85cabeb0ec7c req-c38dbfb8-b9f4-4596-a63e-233be3073e4a service nova] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3f7e8dbe-c91d-4ac3-96c5-85cabeb0ec7c req-c38dbfb8-b9f4-4596-a63e-233be3073e4a service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3f7e8dbe-c91d-4ac3-96c5-85cabeb0ec7c req-c38dbfb8-b9f4-4596-a63e-233be3073e4a service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:35 user nova-compute[72990]: DEBUG nova.compute.manager [req-3f7e8dbe-c91d-4ac3-96c5-85cabeb0ec7c req-c38dbfb8-b9f4-4596-a63e-233be3073e4a service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] No waiting events found dispatching network-vif-plugged-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:50:35 user nova-compute[72990]: WARNING nova.compute.manager [req-3f7e8dbe-c91d-4ac3-96c5-85cabeb0ec7c req-c38dbfb8-b9f4-4596-a63e-233be3073e4a service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received unexpected event network-vif-plugged-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 for instance with vm_state active and task_state None.
Aug 27 03:50:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] No BDM found with device name hda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] No VIF found with MAC fa:16:3e:ef:20:06, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG nova.network.neutron [req-b82ee76d-c3e4-444d-a56c-419f5d7c1708 req-32d30167-bd38-44be-8e51-62ee6d5c5f89 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updated VIF entry in instance network info cache for port 98f21bd1-d0d9-4e27-8ee4-d3b9784974b4. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG nova.network.neutron [req-b82ee76d-c3e4-444d-a56c-419f5d7c1708 req-32d30167-bd38-44be-8e51-62ee6d5c5f89 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updating instance_info_cache with network_info: [{"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b82ee76d-c3e4-444d-a56c-419f5d7c1708 req-32d30167-bd38-44be-8e51-62ee6d5c5f89 service nova] Releasing lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:50:36 user nova-compute[72990]:   <nova:package version="0.0.0"/>
Aug 27 03:50:36 user nova-compute[72990]:   <nova:name>tempest-device-tagging-server-212175205</nova:name>
Aug 27 03:50:36 user nova-compute[72990]:   <nova:creationTime>2023-08-27 03:50:36</nova:creationTime>
Aug 27 03:50:36 user nova-compute[72990]:   <nova:flavor name="m1.tiny">
Aug 27 03:50:36 user nova-compute[72990]:     <nova:memory>512</nova:memory>
Aug 27 03:50:36 user nova-compute[72990]:     <nova:disk>1</nova:disk>
Aug 27 03:50:36 user nova-compute[72990]:     <nova:swap>0</nova:swap>
Aug 27 03:50:36 user nova-compute[72990]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:50:36 user nova-compute[72990]:     <nova:vcpus>1</nova:vcpus>
Aug 27 03:50:36 user nova-compute[72990]:   </nova:flavor>
Aug 27 03:50:36 user nova-compute[72990]:   <nova:owner>
Aug 27 03:50:36 user nova-compute[72990]:     <nova:user uuid="2908a9f30c314839abec26c49028f756">tempest-TaggedAttachmentsTest-2065968082-project-member</nova:user>
Aug 27 03:50:36 user nova-compute[72990]:     <nova:project uuid="f9300e35c8184397bcb840a58209d97c">tempest-TaggedAttachmentsTest-2065968082</nova:project>
Aug 27 03:50:36 user nova-compute[72990]:   </nova:owner>
Aug 27 03:50:36 user nova-compute[72990]:   <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:50:36 user nova-compute[72990]:   <nova:ports>
Aug 27 03:50:36 user nova-compute[72990]:     <nova:port uuid="84ceee62-cd25-4a7f-b1e5-4e327e56d019">
Aug 27 03:50:36 user nova-compute[72990]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 03:50:36 user nova-compute[72990]:     </nova:port>
Aug 27 03:50:36 user nova-compute[72990]:     <nova:port uuid="98f21bd1-d0d9-4e27-8ee4-d3b9784974b4">
Aug 27 03:50:36 user nova-compute[72990]:       <nova:ip type="fixed" address="10.10.10.111" ipVersion="4"/>
Aug 27 03:50:36 user nova-compute[72990]:     </nova:port>
Aug 27 03:50:36 user nova-compute[72990]:   </nova:ports>
Aug 27 03:50:36 user nova-compute[72990]: </nova:instance>
Aug 27 03:50:36 user nova-compute[72990]:  {{(pid=72990) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-71d1f765-cb4c-438a-9d12-34095932c16a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "interface-f2c7f4ed-0c08-4bd8-8386-3830b33a2564-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 5.154s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG nova.objects.instance [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lazy-loading 'flavor' on Instance uuid f2c7f4ed-0c08-4bd8-8386-3830b33a2564 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:36 user nova-compute[72990]: INFO nova.compute.manager [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Attaching volume 0b78ed18-f292-4f09-a53d-d374895a6703 to /dev/vdb
Aug 27 03:50:36 user nova-compute[72990]: DEBUG os_brick.utils [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cc3396-495b-4913-a3e4-3a734a3f9c49]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9ae577-3b77-4f43-8053-90efb562eb99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e8a5d5-1e89-401f-bb27-7e79c8b4be05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cbcb96-09df-47d9-be9c-4dd82feeab73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:50:36 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:50:36 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66f5d97-7546-4679-8253-5f9b2ae3b8ea]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG os_brick.utils [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:50:36 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updating existing volume attachment record: 55b38c75-bad6-4ae9-8f5c-7f00859c449a {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:50:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-ab1d6c90-0bd2-4bd6-b8c2-8b6155cc4ea0 req-9c120db8-9d57-4b40-b668-ae95dc73b6b7 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-vif-plugged-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ab1d6c90-0bd2-4bd6-b8c2-8b6155cc4ea0 req-9c120db8-9d57-4b40-b668-ae95dc73b6b7 service nova] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ab1d6c90-0bd2-4bd6-b8c2-8b6155cc4ea0 req-9c120db8-9d57-4b40-b668-ae95dc73b6b7 service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ab1d6c90-0bd2-4bd6-b8c2-8b6155cc4ea0 req-9c120db8-9d57-4b40-b668-ae95dc73b6b7 service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-ab1d6c90-0bd2-4bd6-b8c2-8b6155cc4ea0 req-9c120db8-9d57-4b40-b668-ae95dc73b6b7 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] No waiting events found dispatching network-vif-plugged-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:50:37 user nova-compute[72990]: WARNING nova.compute.manager [req-ab1d6c90-0bd2-4bd6-b8c2-8b6155cc4ea0 req-9c120db8-9d57-4b40-b668-ae95dc73b6b7 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received unexpected event network-vif-plugged-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 for instance with vm_state active and task_state None.
Aug 27 03:50:38 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108223.7291028, ed1742b9-a19d-43f9-b39a-7257261f858c => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:50:38 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] VM Stopped (Lifecycle Event)
Aug 27 03:50:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-13b354df-d8c7-4b4d-a880-821b5525e9d4 None None] [instance: ed1742b9-a19d-43f9-b39a-7257261f858c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:50:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:43 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108228.8584576, 9052a337-efb8-4a79-95c1-685d22966cec => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:50:43 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] VM Stopped (Lifecycle Event)
Aug 27 03:50:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-bd3ab9e9-28d9-4bd3-b8e0-eff45525c311 None None] [instance: 9052a337-efb8-4a79-95c1-685d22966cec] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:50:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:50:48 user nova-compute[72990]: INFO nova.compute.manager [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] instance snapshotting
Aug 27 03:50:48 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Beginning live snapshot process
Aug 27 03:50:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json -f qcow2 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json -f qcow2 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv2mxepyi/76b16d30904c4364beda58039dbabfe3.delta 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv2mxepyi/76b16d30904c4364beda58039dbabfe3.delta 1073741824" returned: 0 in 0.054s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:49 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 03:50:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:50:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 03:50:50 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 03:50:51 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:50:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv2mxepyi/76b16d30904c4364beda58039dbabfe3.delta /opt/stack/data/nova/instances/snapshots/tmpv2mxepyi/76b16d30904c4364beda58039dbabfe3 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv2mxepyi/76b16d30904c4364beda58039dbabfe3.delta /opt/stack/data/nova/instances/snapshots/tmpv2mxepyi/76b16d30904c4364beda58039dbabfe3" returned: 0 in 0.370s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:51 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Snapshot extracted, beginning image upload
Aug 27 03:50:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:53 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Snapshot image upload complete
Aug 27 03:50:53 user nova-compute[72990]: INFO nova.compute.manager [None req-143dd02e-7c8f-40a2-97d0-2865a30e9dee tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Took 5.11 seconds to snapshot the instance on the hypervisor.
Aug 27 03:50:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "15a88698-88d1-4c6b-9e40-98b618978a33" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-a9dc5dc7-e4e7-422d-a0c3-b51eaa82f3e1 req-c81f03b5-bc1f-4333-b006-92ddaf496bca service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-changed-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:50:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-a9dc5dc7-e4e7-422d-a0c3-b51eaa82f3e1 req-c81f03b5-bc1f-4333-b006-92ddaf496bca service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Refreshing instance network info cache due to event network-changed-1344eed9-36fe-4fce-a572-94a310f2d618. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:50:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a9dc5dc7-e4e7-422d-a0c3-b51eaa82f3e1 req-c81f03b5-bc1f-4333-b006-92ddaf496bca service nova] Acquiring lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:50:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a9dc5dc7-e4e7-422d-a0c3-b51eaa82f3e1 req-c81f03b5-bc1f-4333-b006-92ddaf496bca service nova] Acquired lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:50:54 user nova-compute[72990]: DEBUG nova.network.neutron [req-a9dc5dc7-e4e7-422d-a0c3-b51eaa82f3e1 req-c81f03b5-bc1f-4333-b006-92ddaf496bca service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Refreshing network info cache for port 1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:50:54 user nova-compute[72990]: DEBUG nova.objects.instance [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'flavor' on Instance uuid 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:50:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "15a88698-88d1-4c6b-9e40-98b618978a33" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "15a88698-88d1-4c6b-9e40-98b618978a33" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:54 user nova-compute[72990]: INFO nova.compute.manager [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Attaching volume a40d71b0-dac1-41f5-af3d-df8a97ff5128 to /dev/vdb
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.utils [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaf31fd-4ec6-4e71-90f8-4e1304860740]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab0eece-1172-4ee2-a82d-152f2239a35d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb6ebf3-a11c-4990-8fef-b58b7dc45cd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[725644ec-4e18-4259-bd73-02d329896233]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:50:55 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a447384-9b63-49a0-a8c5-412752fdcb04]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.utils [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updating existing volume attachment record: 2fd92435-1661-433c-881f-84f9479f51ad {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqFQhkUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:50:55 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:50:55 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:50:55 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a92fba-0098-494b-947d-4b8c7acb1a42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:50:55 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb5464d-af23-4750-afb2-784584940142]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703] added
Aug 27 03:50:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[28737fb4-d1fc-4e45-a270-f84ec33c4e26]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG nova.network.neutron [req-a9dc5dc7-e4e7-422d-a0c3-b51eaa82f3e1 req-c81f03b5-bc1f-4333-b006-92ddaf496bca service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updated VIF entry in instance network info cache for port 1344eed9-36fe-4fce-a572-94a310f2d618. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG nova.network.neutron [req-a9dc5dc7-e4e7-422d-a0c3-b51eaa82f3e1 req-c81f03b5-bc1f-4333-b006-92ddaf496bca service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updating instance_info_cache with network_info: [{"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5dddb2-0a32-4b78-853c-9e9b81fc867d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a9dc5dc7-e4e7-422d-a0c3-b51eaa82f3e1 req-c81f03b5-bc1f-4333-b006-92ddaf496bca service nova] Releasing lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqFQhkUL {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqFQhkUL" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba51108-9f2c-4d5b-a89c-0222388e4afc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jqFQhkUL'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45160c3-20fa-41ac-b22a-d803a944ea69]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78d2439-68a5-4163-8b4f-9acd9aa38ecc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:50:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:50:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda33585-f31d-452f-a0ff-4c2fb6dcc253]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703, portal: 172.16.0.220,3260]
Aug 27 03:50:55 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703, portal: 172.16.0.220,3260] successful.
Aug 27 03:50:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5694cc0-cb4b-4e4d-ad8a-58e7d08c1e70]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3498bf9-b9e6-4762-b905-7f6772dd4779]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 (non-flash)
Aug 27 03:50:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:50:55 user nova-compute[72990]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 (non-flash)
Aug 27 03:50:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44aaf92-c0e0-404c-9191-a451c5acae42]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:55 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:50:56 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:50:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqFQhkUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:50:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:50:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26164626263326264', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:50:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164626263326264', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:50:56 user nova-compute[72990]: DEBUG nova.objects.instance [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lazy-loading 'flavor' on Instance uuid f2c7f4ed-0c08-4bd8-8386-3830b33a2564 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:50:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:50:56 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:50:56 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:50:56 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:50:56 user nova-compute[72990]:   <serial>0b78ed18-f292-4f09-a53d-d374895a6703</serial>
Aug 27 03:50:56 user nova-compute[72990]: </disk>
Aug 27 03:50:56 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:50:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:50:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] No BDM found with device name hda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:50:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] No VIF found with MAC fa:16:3e:ef:20:06, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:50:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0c2f3a80-7db8-4f73-8860-a70f75569b5c tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.512s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:50:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:50:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:50:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:50:58 user nova-compute[72990]: INFO nova.compute.manager [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Detaching volume 0b78ed18-f292-4f09-a53d-d374895a6703
Aug 27 03:50:58 user nova-compute[72990]: INFO nova.virt.block_device [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Attempting to driver detach volume 0b78ed18-f292-4f09-a53d-d374895a6703 from mountpoint /dev/vdb
Aug 27 03:50:58 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Attempting to detach device vdb from instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:50:58 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:50:58 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:50:58 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:50:58 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:50:58 user nova-compute[72990]:   <serial>0b78ed18-f292-4f09-a53d-d374895a6703</serial>
Aug 27 03:50:58 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 03:50:58 user nova-compute[72990]: </disk>
Aug 27 03:50:58 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:50:58 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Successfully detached device vdb from instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 from the persistent domain config.
Aug 27 03:50:58 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:50:58 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:50:58 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:50:58 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:50:58 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:50:58 user nova-compute[72990]:   <serial>0b78ed18-f292-4f09-a53d-d374895a6703</serial>
Aug 27 03:50:58 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 03:50:58 user nova-compute[72990]: </disk>
Aug 27 03:50:58 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693108259.388352, f2c7f4ed-0c08-4bd8-8386-3830b33a2564 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:50:59 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Successfully detached device vdb from instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 from the live domain config.
Aug 27 03:50:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqFQhkUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:50:59 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34b35a4-a723-4cd5-83e3-241f6e32fa11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[843d6330-fdc5-400a-aab4-ac43a03e9862]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:50:59 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:50:59 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:50:59 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:50:59 user nova-compute[72990]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 (non-flash)
Aug 27 03:50:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:50:59 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:50:59 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:50:59 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:50:59 user nova-compute[72990]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 (non-flash)
Aug 27 03:50:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7143924d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0864ef-35cb-4a35-8129-7849be1d4167]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d3fe6a-9b4a-4508-b27f-8b664d263073]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[684fff47-f63e-4746-9a91-d5a64cc6e61c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f011f2f-5be1-40a5-add2-ecf138baf875]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef7dd1e-5c5b-43bc-9179-6394479c4be4]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ab8de1-18df-4f86-b857-7ac05a7fc300]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703, portal: 172.16.0.220,3260]
Aug 27 03:50:59 user nova-compute[72990]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703, portal: 172.16.0.220,3260] successful.
Aug 27 03:50:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b78ed18-f292-4f09-a53d-d374895a6703 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f15b30e-17f0-4391-8247-e790ef004663]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] <== disconnect_volume: return (302ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:50:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:51:00 user nova-compute[72990]: DEBUG nova.objects.instance [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lazy-loading 'flavor' on Instance uuid f2c7f4ed-0c08-4bd8-8386-3830b33a2564 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:00 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-59cd67e5-5508-4035-b403-480a6a70461b tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.776s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "interface-f2c7f4ed-0c08-4bd8-8386-3830b33a2564-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "interface-f2c7f4ed-0c08-4bd8-8386-3830b33a2564-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.objects.instance [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lazy-loading 'flavor' on Instance uuid f2c7f4ed-0c08-4bd8-8386-3830b33a2564 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-212175205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-212175205',id=20,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp5iBc6mdgWaggg8GPI462w6II2N5RXXCb7cdBNB2ye3sojol5LvoVHu+BZkBNjSsdZnceTMdoaxLj46rXSeiRp/G2O9qGXI+h1ydtY+K0cIAqh7rlTCqTWWaEgArwZNw==',key_name='tempest-keypair-1954013112',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9300e35c8184397bcb840a58209d97c',ramdisk_id='',reservation_id='r-w1471yyo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2065968082',owner_user_name='tempest-TaggedAttachmentsTest-2065968082-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2908a9f30c314839abec26c49028f756',uuid=f2c7f4ed-0c08-4bd8-8386-3830b33a2564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converting VIF {"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=98f21bd1-d0d9-4e27-8ee4-d3b9784974b4,network=Network(381f95fd-80cf-4633-a1b8-da03f10eb242),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f21bd1-d0') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:ec:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap98f21bd1-d0"/></interface> {{(pid=72990) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:ec:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap98f21bd1-d0"/></interface> {{(pid=72990) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Attempting to detach device tap98f21bd1-d0 from instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] detach device xml: <interface type="ethernet">
Aug 27 03:51:01 user nova-compute[72990]:   <mac address="fa:16:3e:01:ec:9f"/>
Aug 27 03:51:01 user nova-compute[72990]:   <model type="virtio"/>
Aug 27 03:51:01 user nova-compute[72990]:   <mtu size="1442"/>
Aug 27 03:51:01 user nova-compute[72990]:   <target dev="tap98f21bd1-d0"/>
Aug 27 03:51:01 user nova-compute[72990]: </interface>
Aug 27 03:51:01 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:ec:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap98f21bd1-d0"/></interface> {{(pid=72990) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:01:ec:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap98f21bd1-d0"/></interface>not found in domain: <domain type='kvm' id='28'>
Aug 27 03:51:01 user nova-compute[72990]:   <name>instance-00000014</name>
Aug 27 03:51:01 user nova-compute[72990]:   <uuid>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</uuid>
Aug 27 03:51:01 user nova-compute[72990]:   <metadata>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:51:01 user nova-compute[72990]:   <nova:package version="0.0.0"/>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:name>tempest-device-tagging-server-212175205</nova:name>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:creationTime>2023-08-27 03:50:36</nova:creationTime>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:flavor name="m1.tiny">
Aug 27 03:51:01 user nova-compute[72990]:     <nova:memory>512</nova:memory>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:disk>1</nova:disk>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:swap>0</nova:swap>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:vcpus>1</nova:vcpus>
Aug 27 03:51:01 user nova-compute[72990]:   </nova:flavor>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:owner>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:user uuid="2908a9f30c314839abec26c49028f756">tempest-TaggedAttachmentsTest-2065968082-project-member</nova:user>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:project uuid="f9300e35c8184397bcb840a58209d97c">tempest-TaggedAttachmentsTest-2065968082</nova:project>
Aug 27 03:51:01 user nova-compute[72990]:   </nova:owner>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:ports>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:port uuid="84ceee62-cd25-4a7f-b1e5-4e327e56d019">
Aug 27 03:51:01 user nova-compute[72990]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 03:51:01 user nova-compute[72990]:     </nova:port>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:port uuid="98f21bd1-d0d9-4e27-8ee4-d3b9784974b4">
Aug 27 03:51:01 user nova-compute[72990]:       <nova:ip type="fixed" address="10.10.10.111" ipVersion="4"/>
Aug 27 03:51:01 user nova-compute[72990]:     </nova:port>
Aug 27 03:51:01 user nova-compute[72990]:   </nova:ports>
Aug 27 03:51:01 user nova-compute[72990]: </nova:instance>
Aug 27 03:51:01 user nova-compute[72990]:   </metadata>
Aug 27 03:51:01 user nova-compute[72990]:   <memory unit='KiB'>524288</memory>
Aug 27 03:51:01 user nova-compute[72990]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 03:51:01 user nova-compute[72990]:   <vcpu placement='static'>1</vcpu>
Aug 27 03:51:01 user nova-compute[72990]:   <resource>
Aug 27 03:51:01 user nova-compute[72990]:     <partition>/machine</partition>
Aug 27 03:51:01 user nova-compute[72990]:   </resource>
Aug 27 03:51:01 user nova-compute[72990]:   <sysinfo type='smbios'>
Aug 27 03:51:01 user nova-compute[72990]:     <system>
Aug 27 03:51:01 user nova-compute[72990]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 03:51:01 user nova-compute[72990]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 03:51:01 user nova-compute[72990]:       <entry name='version'>0.0.0</entry>
Aug 27 03:51:01 user nova-compute[72990]:       <entry name='serial'>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</entry>
Aug 27 03:51:01 user nova-compute[72990]:       <entry name='uuid'>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</entry>
Aug 27 03:51:01 user nova-compute[72990]:       <entry name='family'>Virtual Machine</entry>
Aug 27 03:51:01 user nova-compute[72990]:     </system>
Aug 27 03:51:01 user nova-compute[72990]:   </sysinfo>
Aug 27 03:51:01 user nova-compute[72990]:   <os>
Aug 27 03:51:01 user nova-compute[72990]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 03:51:01 user nova-compute[72990]:     <boot dev='hd'/>
Aug 27 03:51:01 user nova-compute[72990]:     <smbios mode='sysinfo'/>
Aug 27 03:51:01 user nova-compute[72990]:   </os>
Aug 27 03:51:01 user nova-compute[72990]:   <features>
Aug 27 03:51:01 user nova-compute[72990]:     <acpi/>
Aug 27 03:51:01 user nova-compute[72990]:     <apic/>
Aug 27 03:51:01 user nova-compute[72990]:     <vmcoreinfo state='on'/>
Aug 27 03:51:01 user nova-compute[72990]:   </features>
Aug 27 03:51:01 user nova-compute[72990]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 03:51:01 user nova-compute[72990]:     <model fallback='forbid'>Nehalem</model>
Aug 27 03:51:01 user nova-compute[72990]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 03:51:01 user nova-compute[72990]:     <feature policy='require' name='vme'/>
Aug 27 03:51:01 user nova-compute[72990]:     <feature policy='require' name='x2apic'/>
Aug 27 03:51:01 user nova-compute[72990]:     <feature policy='require' name='hypervisor'/>
Aug 27 03:51:01 user nova-compute[72990]:   </cpu>
Aug 27 03:51:01 user nova-compute[72990]:   <clock offset='utc'>
Aug 27 03:51:01 user nova-compute[72990]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 03:51:01 user nova-compute[72990]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 03:51:01 user nova-compute[72990]:     <timer name='hpet' present='no'/>
Aug 27 03:51:01 user nova-compute[72990]:   </clock>
Aug 27 03:51:01 user nova-compute[72990]:   <on_poweroff>destroy</on_poweroff>
Aug 27 03:51:01 user nova-compute[72990]:   <on_reboot>restart</on_reboot>
Aug 27 03:51:01 user nova-compute[72990]:   <on_crash>destroy</on_crash>
Aug 27 03:51:01 user nova-compute[72990]:   <devices>
Aug 27 03:51:01 user nova-compute[72990]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 03:51:01 user nova-compute[72990]:     <disk type='file' device='disk'>
Aug 27 03:51:01 user nova-compute[72990]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 03:51:01 user nova-compute[72990]:       <source file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk' index='2'/>
Aug 27 03:51:01 user nova-compute[72990]:       <backingStore type='file' index='3'>
Aug 27 03:51:01 user nova-compute[72990]:         <format type='raw'/>
Aug 27 03:51:01 user nova-compute[72990]:         <source file='/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8'/>
Aug 27 03:51:01 user nova-compute[72990]:         <backingStore/>
Aug 27 03:51:01 user nova-compute[72990]:       </backingStore>
Aug 27 03:51:01 user nova-compute[72990]:       <target dev='vda' bus='virtio'/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='virtio-disk0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </disk>
Aug 27 03:51:01 user nova-compute[72990]:     <disk type='file' device='cdrom'>
Aug 27 03:51:01 user nova-compute[72990]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 03:51:01 user nova-compute[72990]:       <source file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk.config' index='1'/>
Aug 27 03:51:01 user nova-compute[72990]:       <backingStore/>
Aug 27 03:51:01 user nova-compute[72990]:       <target dev='hda' bus='ide'/>
Aug 27 03:51:01 user nova-compute[72990]:       <readonly/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='ide0-0-0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </disk>
Aug 27 03:51:01 user nova-compute[72990]:     <controller type='usb' index='0' model='none'>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='usb'/>
Aug 27 03:51:01 user nova-compute[72990]:     </controller>
Aug 27 03:51:01 user nova-compute[72990]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='pci.0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </controller>
Aug 27 03:51:01 user nova-compute[72990]:     <controller type='ide' index='0'>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='ide'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 03:51:01 user nova-compute[72990]:     </controller>
Aug 27 03:51:01 user nova-compute[72990]:     <interface type='ethernet'>
Aug 27 03:51:01 user nova-compute[72990]:       <mac address='fa:16:3e:ef:20:06'/>
Aug 27 03:51:01 user nova-compute[72990]:       <target dev='tap84ceee62-cd'/>
Aug 27 03:51:01 user nova-compute[72990]:       <model type='virtio'/>
Aug 27 03:51:01 user nova-compute[72990]:       <mtu size='1442'/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='net0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </interface>
Aug 27 03:51:01 user nova-compute[72990]:     <interface type='ethernet'>
Aug 27 03:51:01 user nova-compute[72990]:       <mac address='fa:16:3e:01:ec:9f'/>
Aug 27 03:51:01 user nova-compute[72990]:       <target dev='tap98f21bd1-d0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <model type='virtio'/>
Aug 27 03:51:01 user nova-compute[72990]:       <mtu size='1442'/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='net1'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </interface>
Aug 27 03:51:01 user nova-compute[72990]:     <serial type='pty'>
Aug 27 03:51:01 user nova-compute[72990]:       <source path='/dev/pts/8'/>
Aug 27 03:51:01 user nova-compute[72990]:       <log file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/console.log' append='off'/>
Aug 27 03:51:01 user nova-compute[72990]:       <target type='isa-serial' port='0'>
Aug 27 03:51:01 user nova-compute[72990]:         <model name='isa-serial'/>
Aug 27 03:51:01 user nova-compute[72990]:       </target>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='serial0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </serial>
Aug 27 03:51:01 user nova-compute[72990]:     <console type='pty' tty='/dev/pts/8'>
Aug 27 03:51:01 user nova-compute[72990]:       <source path='/dev/pts/8'/>
Aug 27 03:51:01 user nova-compute[72990]:       <log file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/console.log' append='off'/>
Aug 27 03:51:01 user nova-compute[72990]:       <target type='serial' port='0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='serial0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </console>
Aug 27 03:51:01 user nova-compute[72990]:     <input type='mouse' bus='ps2'>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='input0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </input>
Aug 27 03:51:01 user nova-compute[72990]:     <input type='keyboard' bus='ps2'>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='input1'/>
Aug 27 03:51:01 user nova-compute[72990]:     </input>
Aug 27 03:51:01 user nova-compute[72990]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 27 03:51:01 user nova-compute[72990]:       <listen type='address' address='0.0.0.0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </graphics>
Aug 27 03:51:01 user nova-compute[72990]:     <audio id='1' type='none'/>
Aug 27 03:51:01 user nova-compute[72990]:     <video>
Aug 27 03:51:01 user nova-compute[72990]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='video0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </video>
Aug 27 03:51:01 user nova-compute[72990]:     <memballoon model='virtio'>
Aug 27 03:51:01 user nova-compute[72990]:       <stats period='10'/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='balloon0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </memballoon>
Aug 27 03:51:01 user nova-compute[72990]:     <rng model='virtio'>
Aug 27 03:51:01 user nova-compute[72990]:       <backend model='random'>/dev/urandom</backend>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='rng0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </rng>
Aug 27 03:51:01 user nova-compute[72990]:   </devices>
Aug 27 03:51:01 user nova-compute[72990]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 03:51:01 user nova-compute[72990]:     <label>libvirt-f2c7f4ed-0c08-4bd8-8386-3830b33a2564</label>
Aug 27 03:51:01 user nova-compute[72990]:     <imagelabel>libvirt-f2c7f4ed-0c08-4bd8-8386-3830b33a2564</imagelabel>
Aug 27 03:51:01 user nova-compute[72990]:   </seclabel>
Aug 27 03:51:01 user nova-compute[72990]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 03:51:01 user nova-compute[72990]:     <label>+64055:+108</label>
Aug 27 03:51:01 user nova-compute[72990]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 03:51:01 user nova-compute[72990]:   </seclabel>
Aug 27 03:51:01 user nova-compute[72990]: </domain>
Aug 27 03:51:01 user nova-compute[72990]:  {{(pid=72990) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 03:51:01 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Successfully detached device tap98f21bd1-d0 from instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 from the persistent domain config.
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] (1/8): Attempting to detach device tap98f21bd1-d0 with device alias net1 from instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] detach device xml: <interface type="ethernet">
Aug 27 03:51:01 user nova-compute[72990]:   <mac address="fa:16:3e:01:ec:9f"/>
Aug 27 03:51:01 user nova-compute[72990]:   <model type="virtio"/>
Aug 27 03:51:01 user nova-compute[72990]:   <mtu size="1442"/>
Aug 27 03:51:01 user nova-compute[72990]:   <target dev="tap98f21bd1-d0"/>
Aug 27 03:51:01 user nova-compute[72990]: </interface>
Aug 27 03:51:01 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693108261.441175, f2c7f4ed-0c08-4bd8-8386-3830b33a2564 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Start waiting for the detach event from libvirt for device tap98f21bd1-d0 with device alias net1 for instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:ec:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap98f21bd1-d0"/></interface> {{(pid=72990) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:01:ec:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap98f21bd1-d0"/></interface>not found in domain: <domain type='kvm' id='28'>
Aug 27 03:51:01 user nova-compute[72990]:   <name>instance-00000014</name>
Aug 27 03:51:01 user nova-compute[72990]:   <uuid>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</uuid>
Aug 27 03:51:01 user nova-compute[72990]:   <metadata>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:51:01 user nova-compute[72990]:   <nova:package version="0.0.0"/>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:name>tempest-device-tagging-server-212175205</nova:name>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:creationTime>2023-08-27 03:50:36</nova:creationTime>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:flavor name="m1.tiny">
Aug 27 03:51:01 user nova-compute[72990]:     <nova:memory>512</nova:memory>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:disk>1</nova:disk>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:swap>0</nova:swap>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:vcpus>1</nova:vcpus>
Aug 27 03:51:01 user nova-compute[72990]:   </nova:flavor>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:owner>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:user uuid="2908a9f30c314839abec26c49028f756">tempest-TaggedAttachmentsTest-2065968082-project-member</nova:user>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:project uuid="f9300e35c8184397bcb840a58209d97c">tempest-TaggedAttachmentsTest-2065968082</nova:project>
Aug 27 03:51:01 user nova-compute[72990]:   </nova:owner>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:ports>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:port uuid="84ceee62-cd25-4a7f-b1e5-4e327e56d019">
Aug 27 03:51:01 user nova-compute[72990]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 03:51:01 user nova-compute[72990]:     </nova:port>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:port uuid="98f21bd1-d0d9-4e27-8ee4-d3b9784974b4">
Aug 27 03:51:01 user nova-compute[72990]:       <nova:ip type="fixed" address="10.10.10.111" ipVersion="4"/>
Aug 27 03:51:01 user nova-compute[72990]:     </nova:port>
Aug 27 03:51:01 user nova-compute[72990]:   </nova:ports>
Aug 27 03:51:01 user nova-compute[72990]: </nova:instance>
Aug 27 03:51:01 user nova-compute[72990]:   </metadata>
Aug 27 03:51:01 user nova-compute[72990]:   <memory unit='KiB'>524288</memory>
Aug 27 03:51:01 user nova-compute[72990]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 03:51:01 user nova-compute[72990]:   <vcpu placement='static'>1</vcpu>
Aug 27 03:51:01 user nova-compute[72990]:   <resource>
Aug 27 03:51:01 user nova-compute[72990]:     <partition>/machine</partition>
Aug 27 03:51:01 user nova-compute[72990]:   </resource>
Aug 27 03:51:01 user nova-compute[72990]:   <sysinfo type='smbios'>
Aug 27 03:51:01 user nova-compute[72990]:     <system>
Aug 27 03:51:01 user nova-compute[72990]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 03:51:01 user nova-compute[72990]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 03:51:01 user nova-compute[72990]:       <entry name='version'>0.0.0</entry>
Aug 27 03:51:01 user nova-compute[72990]:       <entry name='serial'>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</entry>
Aug 27 03:51:01 user nova-compute[72990]:       <entry name='uuid'>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</entry>
Aug 27 03:51:01 user nova-compute[72990]:       <entry name='family'>Virtual Machine</entry>
Aug 27 03:51:01 user nova-compute[72990]:     </system>
Aug 27 03:51:01 user nova-compute[72990]:   </sysinfo>
Aug 27 03:51:01 user nova-compute[72990]:   <os>
Aug 27 03:51:01 user nova-compute[72990]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 03:51:01 user nova-compute[72990]:     <boot dev='hd'/>
Aug 27 03:51:01 user nova-compute[72990]:     <smbios mode='sysinfo'/>
Aug 27 03:51:01 user nova-compute[72990]:   </os>
Aug 27 03:51:01 user nova-compute[72990]:   <features>
Aug 27 03:51:01 user nova-compute[72990]:     <acpi/>
Aug 27 03:51:01 user nova-compute[72990]:     <apic/>
Aug 27 03:51:01 user nova-compute[72990]:     <vmcoreinfo state='on'/>
Aug 27 03:51:01 user nova-compute[72990]:   </features>
Aug 27 03:51:01 user nova-compute[72990]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 03:51:01 user nova-compute[72990]:     <model fallback='forbid'>Nehalem</model>
Aug 27 03:51:01 user nova-compute[72990]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 03:51:01 user nova-compute[72990]:     <feature policy='require' name='vme'/>
Aug 27 03:51:01 user nova-compute[72990]:     <feature policy='require' name='x2apic'/>
Aug 27 03:51:01 user nova-compute[72990]:     <feature policy='require' name='hypervisor'/>
Aug 27 03:51:01 user nova-compute[72990]:   </cpu>
Aug 27 03:51:01 user nova-compute[72990]:   <clock offset='utc'>
Aug 27 03:51:01 user nova-compute[72990]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 03:51:01 user nova-compute[72990]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 03:51:01 user nova-compute[72990]:     <timer name='hpet' present='no'/>
Aug 27 03:51:01 user nova-compute[72990]:   </clock>
Aug 27 03:51:01 user nova-compute[72990]:   <on_poweroff>destroy</on_poweroff>
Aug 27 03:51:01 user nova-compute[72990]:   <on_reboot>restart</on_reboot>
Aug 27 03:51:01 user nova-compute[72990]:   <on_crash>destroy</on_crash>
Aug 27 03:51:01 user nova-compute[72990]:   <devices>
Aug 27 03:51:01 user nova-compute[72990]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 03:51:01 user nova-compute[72990]:     <disk type='file' device='disk'>
Aug 27 03:51:01 user nova-compute[72990]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 03:51:01 user nova-compute[72990]:       <source file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk' index='2'/>
Aug 27 03:51:01 user nova-compute[72990]:       <backingStore type='file' index='3'>
Aug 27 03:51:01 user nova-compute[72990]:         <format type='raw'/>
Aug 27 03:51:01 user nova-compute[72990]:         <source file='/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8'/>
Aug 27 03:51:01 user nova-compute[72990]:         <backingStore/>
Aug 27 03:51:01 user nova-compute[72990]:       </backingStore>
Aug 27 03:51:01 user nova-compute[72990]:       <target dev='vda' bus='virtio'/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='virtio-disk0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </disk>
Aug 27 03:51:01 user nova-compute[72990]:     <disk type='file' device='cdrom'>
Aug 27 03:51:01 user nova-compute[72990]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 03:51:01 user nova-compute[72990]:       <source file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk.config' index='1'/>
Aug 27 03:51:01 user nova-compute[72990]:       <backingStore/>
Aug 27 03:51:01 user nova-compute[72990]:       <target dev='hda' bus='ide'/>
Aug 27 03:51:01 user nova-compute[72990]:       <readonly/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='ide0-0-0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </disk>
Aug 27 03:51:01 user nova-compute[72990]:     <controller type='usb' index='0' model='none'>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='usb'/>
Aug 27 03:51:01 user nova-compute[72990]:     </controller>
Aug 27 03:51:01 user nova-compute[72990]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='pci.0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </controller>
Aug 27 03:51:01 user nova-compute[72990]:     <controller type='ide' index='0'>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='ide'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 03:51:01 user nova-compute[72990]:     </controller>
Aug 27 03:51:01 user nova-compute[72990]:     <interface type='ethernet'>
Aug 27 03:51:01 user nova-compute[72990]:       <mac address='fa:16:3e:ef:20:06'/>
Aug 27 03:51:01 user nova-compute[72990]:       <target dev='tap84ceee62-cd'/>
Aug 27 03:51:01 user nova-compute[72990]:       <model type='virtio'/>
Aug 27 03:51:01 user nova-compute[72990]:       <mtu size='1442'/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='net0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </interface>
Aug 27 03:51:01 user nova-compute[72990]:     <serial type='pty'>
Aug 27 03:51:01 user nova-compute[72990]:       <source path='/dev/pts/8'/>
Aug 27 03:51:01 user nova-compute[72990]:       <log file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/console.log' append='off'/>
Aug 27 03:51:01 user nova-compute[72990]:       <target type='isa-serial' port='0'>
Aug 27 03:51:01 user nova-compute[72990]:         <model name='isa-serial'/>
Aug 27 03:51:01 user nova-compute[72990]:       </target>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='serial0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </serial>
Aug 27 03:51:01 user nova-compute[72990]:     <console type='pty' tty='/dev/pts/8'>
Aug 27 03:51:01 user nova-compute[72990]:       <source path='/dev/pts/8'/>
Aug 27 03:51:01 user nova-compute[72990]:       <log file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/console.log' append='off'/>
Aug 27 03:51:01 user nova-compute[72990]:       <target type='serial' port='0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='serial0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </console>
Aug 27 03:51:01 user nova-compute[72990]:     <input type='mouse' bus='ps2'>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='input0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </input>
Aug 27 03:51:01 user nova-compute[72990]:     <input type='keyboard' bus='ps2'>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='input1'/>
Aug 27 03:51:01 user nova-compute[72990]:     </input>
Aug 27 03:51:01 user nova-compute[72990]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 27 03:51:01 user nova-compute[72990]:       <listen type='address' address='0.0.0.0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </graphics>
Aug 27 03:51:01 user nova-compute[72990]:     <audio id='1' type='none'/>
Aug 27 03:51:01 user nova-compute[72990]:     <video>
Aug 27 03:51:01 user nova-compute[72990]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='video0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </video>
Aug 27 03:51:01 user nova-compute[72990]:     <memballoon model='virtio'>
Aug 27 03:51:01 user nova-compute[72990]:       <stats period='10'/>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='balloon0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </memballoon>
Aug 27 03:51:01 user nova-compute[72990]:     <rng model='virtio'>
Aug 27 03:51:01 user nova-compute[72990]:       <backend model='random'>/dev/urandom</backend>
Aug 27 03:51:01 user nova-compute[72990]:       <alias name='rng0'/>
Aug 27 03:51:01 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 03:51:01 user nova-compute[72990]:     </rng>
Aug 27 03:51:01 user nova-compute[72990]:   </devices>
Aug 27 03:51:01 user nova-compute[72990]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 03:51:01 user nova-compute[72990]:     <label>libvirt-f2c7f4ed-0c08-4bd8-8386-3830b33a2564</label>
Aug 27 03:51:01 user nova-compute[72990]:     <imagelabel>libvirt-f2c7f4ed-0c08-4bd8-8386-3830b33a2564</imagelabel>
Aug 27 03:51:01 user nova-compute[72990]:   </seclabel>
Aug 27 03:51:01 user nova-compute[72990]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 03:51:01 user nova-compute[72990]:     <label>+64055:+108</label>
Aug 27 03:51:01 user nova-compute[72990]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 03:51:01 user nova-compute[72990]:   </seclabel>
Aug 27 03:51:01 user nova-compute[72990]: </domain>
Aug 27 03:51:01 user nova-compute[72990]:  {{(pid=72990) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 03:51:01 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Successfully detached device tap98f21bd1-d0 from instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 from the live domain config.
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-212175205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-212175205',id=20,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp5iBc6mdgWaggg8GPI462w6II2N5RXXCb7cdBNB2ye3sojol5LvoVHu+BZkBNjSsdZnceTMdoaxLj46rXSeiRp/G2O9qGXI+h1ydtY+K0cIAqh7rlTCqTWWaEgArwZNw==',key_name='tempest-keypair-1954013112',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9300e35c8184397bcb840a58209d97c',ramdisk_id='',reservation_id='r-w1471yyo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2065968082',owner_user_name='tempest-TaggedAttachmentsTest-2065968082-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2908a9f30c314839abec26c49028f756',uuid=f2c7f4ed-0c08-4bd8-8386-3830b33a2564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converting VIF {"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=98f21bd1-d0d9-4e27-8ee4-d3b9784974b4,network=Network(381f95fd-80cf-4633-a1b8-da03f10eb242),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f21bd1-d0') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG os_vif [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=98f21bd1-d0d9-4e27-8ee4-d3b9784974b4,network=Network(381f95fd-80cf-4633-a1b8-da03f10eb242),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f21bd1-d0') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98f21bd1-d0, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:01 user nova-compute[72990]: INFO os_vif [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=98f21bd1-d0d9-4e27-8ee4-d3b9784974b4,network=Network(381f95fd-80cf-4633-a1b8-da03f10eb242),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f21bd1-d0')
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:51:01 user nova-compute[72990]:   <nova:package version="0.0.0"/>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:name>tempest-device-tagging-server-212175205</nova:name>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:creationTime>2023-08-27 03:51:01</nova:creationTime>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:flavor name="m1.tiny">
Aug 27 03:51:01 user nova-compute[72990]:     <nova:memory>512</nova:memory>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:disk>1</nova:disk>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:swap>0</nova:swap>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:vcpus>1</nova:vcpus>
Aug 27 03:51:01 user nova-compute[72990]:   </nova:flavor>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:owner>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:user uuid="2908a9f30c314839abec26c49028f756">tempest-TaggedAttachmentsTest-2065968082-project-member</nova:user>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:project uuid="f9300e35c8184397bcb840a58209d97c">tempest-TaggedAttachmentsTest-2065968082</nova:project>
Aug 27 03:51:01 user nova-compute[72990]:   </nova:owner>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:51:01 user nova-compute[72990]:   <nova:ports>
Aug 27 03:51:01 user nova-compute[72990]:     <nova:port uuid="84ceee62-cd25-4a7f-b1e5-4e327e56d019">
Aug 27 03:51:01 user nova-compute[72990]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 03:51:01 user nova-compute[72990]:     </nova:port>
Aug 27 03:51:01 user nova-compute[72990]:   </nova:ports>
Aug 27 03:51:01 user nova-compute[72990]: </nova:instance>
Aug 27 03:51:01 user nova-compute[72990]:  {{(pid=72990) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-e1ced74f-4845-496c-acb2-48529c0abffe req-a4fac344-d995-417d-817f-2365f5706bb4 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-vif-unplugged-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e1ced74f-4845-496c-acb2-48529c0abffe req-a4fac344-d995-417d-817f-2365f5706bb4 service nova] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e1ced74f-4845-496c-acb2-48529c0abffe req-a4fac344-d995-417d-817f-2365f5706bb4 service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e1ced74f-4845-496c-acb2-48529c0abffe req-a4fac344-d995-417d-817f-2365f5706bb4 service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-e1ced74f-4845-496c-acb2-48529c0abffe req-a4fac344-d995-417d-817f-2365f5706bb4 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] No waiting events found dispatching network-vif-unplugged-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:01 user nova-compute[72990]: WARNING nova.compute.manager [req-e1ced74f-4845-496c-acb2-48529c0abffe req-a4fac344-d995-417d-817f-2365f5706bb4 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received unexpected event network-vif-unplugged-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 for instance with vm_state active and task_state None.
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-vif-deleted-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:02 user nova-compute[72990]: INFO nova.compute.manager [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Neutron deleted interface 98f21bd1-d0d9-4e27-8ee4-d3b9784974b4; detaching it from the instance and deleting it from the info cache
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.network.neutron [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updating instance_info_cache with network_info: [{"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquired lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.network.neutron [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.objects.instance [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] Lazy-loading 'system_metadata' on Instance uuid f2c7f4ed-0c08-4bd8-8386-3830b33a2564 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.objects.instance [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] Lazy-loading 'flavor' on Instance uuid f2c7f4ed-0c08-4bd8-8386-3830b33a2564 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.objects.base [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] Object Instance<f2c7f4ed-0c08-4bd8-8386-3830b33a2564> lazy-loaded attributes: system_metadata,flavor {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-212175205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-212175205',id=20,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp5iBc6mdgWaggg8GPI462w6II2N5RXXCb7cdBNB2ye3sojol5LvoVHu+BZkBNjSsdZnceTMdoaxLj46rXSeiRp/G2O9qGXI+h1ydtY+K0cIAqh7rlTCqTWWaEgArwZNw==',key_name='tempest-keypair-1954013112',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9300e35c8184397bcb840a58209d97c',ramdisk_id='',reservation_id='r-w1471yyo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2065968082',owner_user_name='tempest-TaggedAttachmentsTest-2065968082-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2908a9f30c314839abec26c49028f756',uuid=f2c7f4ed-0c08-4bd8-8386-3830b33a2564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.network.os_vif_util [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] Converting VIF {"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.network.os_vif_util [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=98f21bd1-d0d9-4e27-8ee4-d3b9784974b4,network=Network(381f95fd-80cf-4633-a1b8-da03f10eb242),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f21bd1-d0') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:ec:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap98f21bd1-d0"/></interface> {{(pid=72990) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:01:ec:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap98f21bd1-d0"/></interface>not found in domain: <domain type='kvm' id='28'>
Aug 27 03:51:02 user nova-compute[72990]:   <name>instance-00000014</name>
Aug 27 03:51:02 user nova-compute[72990]:   <uuid>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</uuid>
Aug 27 03:51:02 user nova-compute[72990]:   <metadata>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:51:02 user nova-compute[72990]:   <nova:package version="0.0.0"/>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:name>tempest-device-tagging-server-212175205</nova:name>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:creationTime>2023-08-27 03:51:01</nova:creationTime>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:flavor name="m1.tiny">
Aug 27 03:51:02 user nova-compute[72990]:     <nova:memory>512</nova:memory>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:disk>1</nova:disk>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:swap>0</nova:swap>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:vcpus>1</nova:vcpus>
Aug 27 03:51:02 user nova-compute[72990]:   </nova:flavor>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:owner>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:user uuid="2908a9f30c314839abec26c49028f756">tempest-TaggedAttachmentsTest-2065968082-project-member</nova:user>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:project uuid="f9300e35c8184397bcb840a58209d97c">tempest-TaggedAttachmentsTest-2065968082</nova:project>
Aug 27 03:51:02 user nova-compute[72990]:   </nova:owner>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:ports>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:port uuid="84ceee62-cd25-4a7f-b1e5-4e327e56d019">
Aug 27 03:51:02 user nova-compute[72990]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 03:51:02 user nova-compute[72990]:     </nova:port>
Aug 27 03:51:02 user nova-compute[72990]:   </nova:ports>
Aug 27 03:51:02 user nova-compute[72990]: </nova:instance>
Aug 27 03:51:02 user nova-compute[72990]:   </metadata>
Aug 27 03:51:02 user nova-compute[72990]:   <memory unit='KiB'>524288</memory>
Aug 27 03:51:02 user nova-compute[72990]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 03:51:02 user nova-compute[72990]:   <vcpu placement='static'>1</vcpu>
Aug 27 03:51:02 user nova-compute[72990]:   <resource>
Aug 27 03:51:02 user nova-compute[72990]:     <partition>/machine</partition>
Aug 27 03:51:02 user nova-compute[72990]:   </resource>
Aug 27 03:51:02 user nova-compute[72990]:   <sysinfo type='smbios'>
Aug 27 03:51:02 user nova-compute[72990]:     <system>
Aug 27 03:51:02 user nova-compute[72990]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 03:51:02 user nova-compute[72990]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 03:51:02 user nova-compute[72990]:       <entry name='version'>0.0.0</entry>
Aug 27 03:51:02 user nova-compute[72990]:       <entry name='serial'>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</entry>
Aug 27 03:51:02 user nova-compute[72990]:       <entry name='uuid'>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</entry>
Aug 27 03:51:02 user nova-compute[72990]:       <entry name='family'>Virtual Machine</entry>
Aug 27 03:51:02 user nova-compute[72990]:     </system>
Aug 27 03:51:02 user nova-compute[72990]:   </sysinfo>
Aug 27 03:51:02 user nova-compute[72990]:   <os>
Aug 27 03:51:02 user nova-compute[72990]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 03:51:02 user nova-compute[72990]:     <boot dev='hd'/>
Aug 27 03:51:02 user nova-compute[72990]:     <smbios mode='sysinfo'/>
Aug 27 03:51:02 user nova-compute[72990]:   </os>
Aug 27 03:51:02 user nova-compute[72990]:   <features>
Aug 27 03:51:02 user nova-compute[72990]:     <acpi/>
Aug 27 03:51:02 user nova-compute[72990]:     <apic/>
Aug 27 03:51:02 user nova-compute[72990]:     <vmcoreinfo state='on'/>
Aug 27 03:51:02 user nova-compute[72990]:   </features>
Aug 27 03:51:02 user nova-compute[72990]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 03:51:02 user nova-compute[72990]:     <model fallback='forbid'>Nehalem</model>
Aug 27 03:51:02 user nova-compute[72990]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 03:51:02 user nova-compute[72990]:     <feature policy='require' name='vme'/>
Aug 27 03:51:02 user nova-compute[72990]:     <feature policy='require' name='x2apic'/>
Aug 27 03:51:02 user nova-compute[72990]:     <feature policy='require' name='hypervisor'/>
Aug 27 03:51:02 user nova-compute[72990]:   </cpu>
Aug 27 03:51:02 user nova-compute[72990]:   <clock offset='utc'>
Aug 27 03:51:02 user nova-compute[72990]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 03:51:02 user nova-compute[72990]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 03:51:02 user nova-compute[72990]:     <timer name='hpet' present='no'/>
Aug 27 03:51:02 user nova-compute[72990]:   </clock>
Aug 27 03:51:02 user nova-compute[72990]:   <on_poweroff>destroy</on_poweroff>
Aug 27 03:51:02 user nova-compute[72990]:   <on_reboot>restart</on_reboot>
Aug 27 03:51:02 user nova-compute[72990]:   <on_crash>destroy</on_crash>
Aug 27 03:51:02 user nova-compute[72990]:   <devices>
Aug 27 03:51:02 user nova-compute[72990]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 03:51:02 user nova-compute[72990]:     <disk type='file' device='disk'>
Aug 27 03:51:02 user nova-compute[72990]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 03:51:02 user nova-compute[72990]:       <source file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk' index='2'/>
Aug 27 03:51:02 user nova-compute[72990]:       <backingStore type='file' index='3'>
Aug 27 03:51:02 user nova-compute[72990]:         <format type='raw'/>
Aug 27 03:51:02 user nova-compute[72990]:         <source file='/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8'/>
Aug 27 03:51:02 user nova-compute[72990]:         <backingStore/>
Aug 27 03:51:02 user nova-compute[72990]:       </backingStore>
Aug 27 03:51:02 user nova-compute[72990]:       <target dev='vda' bus='virtio'/>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='virtio-disk0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </disk>
Aug 27 03:51:02 user nova-compute[72990]:     <disk type='file' device='cdrom'>
Aug 27 03:51:02 user nova-compute[72990]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 03:51:02 user nova-compute[72990]:       <source file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk.config' index='1'/>
Aug 27 03:51:02 user nova-compute[72990]:       <backingStore/>
Aug 27 03:51:02 user nova-compute[72990]:       <target dev='hda' bus='ide'/>
Aug 27 03:51:02 user nova-compute[72990]:       <readonly/>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='ide0-0-0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </disk>
Aug 27 03:51:02 user nova-compute[72990]:     <controller type='usb' index='0' model='none'>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='usb'/>
Aug 27 03:51:02 user nova-compute[72990]:     </controller>
Aug 27 03:51:02 user nova-compute[72990]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='pci.0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </controller>
Aug 27 03:51:02 user nova-compute[72990]:     <controller type='ide' index='0'>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='ide'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 03:51:02 user nova-compute[72990]:     </controller>
Aug 27 03:51:02 user nova-compute[72990]:     <interface type='ethernet'>
Aug 27 03:51:02 user nova-compute[72990]:       <mac address='fa:16:3e:ef:20:06'/>
Aug 27 03:51:02 user nova-compute[72990]:       <target dev='tap84ceee62-cd'/>
Aug 27 03:51:02 user nova-compute[72990]:       <model type='virtio'/>
Aug 27 03:51:02 user nova-compute[72990]:       <mtu size='1442'/>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='net0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </interface>
Aug 27 03:51:02 user nova-compute[72990]:     <serial type='pty'>
Aug 27 03:51:02 user nova-compute[72990]:       <source path='/dev/pts/8'/>
Aug 27 03:51:02 user nova-compute[72990]:       <log file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/console.log' append='off'/>
Aug 27 03:51:02 user nova-compute[72990]:       <target type='isa-serial' port='0'>
Aug 27 03:51:02 user nova-compute[72990]:         <model name='isa-serial'/>
Aug 27 03:51:02 user nova-compute[72990]:       </target>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='serial0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </serial>
Aug 27 03:51:02 user nova-compute[72990]:     <console type='pty' tty='/dev/pts/8'>
Aug 27 03:51:02 user nova-compute[72990]:       <source path='/dev/pts/8'/>
Aug 27 03:51:02 user nova-compute[72990]:       <log file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/console.log' append='off'/>
Aug 27 03:51:02 user nova-compute[72990]:       <target type='serial' port='0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='serial0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </console>
Aug 27 03:51:02 user nova-compute[72990]:     <input type='mouse' bus='ps2'>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='input0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </input>
Aug 27 03:51:02 user nova-compute[72990]:     <input type='keyboard' bus='ps2'>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='input1'/>
Aug 27 03:51:02 user nova-compute[72990]:     </input>
Aug 27 03:51:02 user nova-compute[72990]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 27 03:51:02 user nova-compute[72990]:       <listen type='address' address='0.0.0.0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </graphics>
Aug 27 03:51:02 user nova-compute[72990]:     <audio id='1' type='none'/>
Aug 27 03:51:02 user nova-compute[72990]:     <video>
Aug 27 03:51:02 user nova-compute[72990]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='video0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </video>
Aug 27 03:51:02 user nova-compute[72990]:     <memballoon model='virtio'>
Aug 27 03:51:02 user nova-compute[72990]:       <stats period='10'/>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='balloon0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </memballoon>
Aug 27 03:51:02 user nova-compute[72990]:     <rng model='virtio'>
Aug 27 03:51:02 user nova-compute[72990]:       <backend model='random'>/dev/urandom</backend>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='rng0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </rng>
Aug 27 03:51:02 user nova-compute[72990]:   </devices>
Aug 27 03:51:02 user nova-compute[72990]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 03:51:02 user nova-compute[72990]:     <label>libvirt-f2c7f4ed-0c08-4bd8-8386-3830b33a2564</label>
Aug 27 03:51:02 user nova-compute[72990]:     <imagelabel>libvirt-f2c7f4ed-0c08-4bd8-8386-3830b33a2564</imagelabel>
Aug 27 03:51:02 user nova-compute[72990]:   </seclabel>
Aug 27 03:51:02 user nova-compute[72990]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 03:51:02 user nova-compute[72990]:     <label>+64055:+108</label>
Aug 27 03:51:02 user nova-compute[72990]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 03:51:02 user nova-compute[72990]:   </seclabel>
Aug 27 03:51:02 user nova-compute[72990]: </domain>
Aug 27 03:51:02 user nova-compute[72990]:  {{(pid=72990) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:ec:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap98f21bd1-d0"/></interface> {{(pid=72990) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:01:ec:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap98f21bd1-d0"/></interface>not found in domain: <domain type='kvm' id='28'>
Aug 27 03:51:02 user nova-compute[72990]:   <name>instance-00000014</name>
Aug 27 03:51:02 user nova-compute[72990]:   <uuid>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</uuid>
Aug 27 03:51:02 user nova-compute[72990]:   <metadata>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:51:02 user nova-compute[72990]:   <nova:package version="0.0.0"/>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:name>tempest-device-tagging-server-212175205</nova:name>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:creationTime>2023-08-27 03:51:01</nova:creationTime>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:flavor name="m1.tiny">
Aug 27 03:51:02 user nova-compute[72990]:     <nova:memory>512</nova:memory>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:disk>1</nova:disk>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:swap>0</nova:swap>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:vcpus>1</nova:vcpus>
Aug 27 03:51:02 user nova-compute[72990]:   </nova:flavor>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:owner>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:user uuid="2908a9f30c314839abec26c49028f756">tempest-TaggedAttachmentsTest-2065968082-project-member</nova:user>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:project uuid="f9300e35c8184397bcb840a58209d97c">tempest-TaggedAttachmentsTest-2065968082</nova:project>
Aug 27 03:51:02 user nova-compute[72990]:   </nova:owner>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:ports>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:port uuid="84ceee62-cd25-4a7f-b1e5-4e327e56d019">
Aug 27 03:51:02 user nova-compute[72990]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 03:51:02 user nova-compute[72990]:     </nova:port>
Aug 27 03:51:02 user nova-compute[72990]:   </nova:ports>
Aug 27 03:51:02 user nova-compute[72990]: </nova:instance>
Aug 27 03:51:02 user nova-compute[72990]:   </metadata>
Aug 27 03:51:02 user nova-compute[72990]:   <memory unit='KiB'>524288</memory>
Aug 27 03:51:02 user nova-compute[72990]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 03:51:02 user nova-compute[72990]:   <vcpu placement='static'>1</vcpu>
Aug 27 03:51:02 user nova-compute[72990]:   <resource>
Aug 27 03:51:02 user nova-compute[72990]:     <partition>/machine</partition>
Aug 27 03:51:02 user nova-compute[72990]:   </resource>
Aug 27 03:51:02 user nova-compute[72990]:   <sysinfo type='smbios'>
Aug 27 03:51:02 user nova-compute[72990]:     <system>
Aug 27 03:51:02 user nova-compute[72990]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 03:51:02 user nova-compute[72990]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 03:51:02 user nova-compute[72990]:       <entry name='version'>0.0.0</entry>
Aug 27 03:51:02 user nova-compute[72990]:       <entry name='serial'>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</entry>
Aug 27 03:51:02 user nova-compute[72990]:       <entry name='uuid'>f2c7f4ed-0c08-4bd8-8386-3830b33a2564</entry>
Aug 27 03:51:02 user nova-compute[72990]:       <entry name='family'>Virtual Machine</entry>
Aug 27 03:51:02 user nova-compute[72990]:     </system>
Aug 27 03:51:02 user nova-compute[72990]:   </sysinfo>
Aug 27 03:51:02 user nova-compute[72990]:   <os>
Aug 27 03:51:02 user nova-compute[72990]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 03:51:02 user nova-compute[72990]:     <boot dev='hd'/>
Aug 27 03:51:02 user nova-compute[72990]:     <smbios mode='sysinfo'/>
Aug 27 03:51:02 user nova-compute[72990]:   </os>
Aug 27 03:51:02 user nova-compute[72990]:   <features>
Aug 27 03:51:02 user nova-compute[72990]:     <acpi/>
Aug 27 03:51:02 user nova-compute[72990]:     <apic/>
Aug 27 03:51:02 user nova-compute[72990]:     <vmcoreinfo state='on'/>
Aug 27 03:51:02 user nova-compute[72990]:   </features>
Aug 27 03:51:02 user nova-compute[72990]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 03:51:02 user nova-compute[72990]:     <model fallback='forbid'>Nehalem</model>
Aug 27 03:51:02 user nova-compute[72990]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 03:51:02 user nova-compute[72990]:     <feature policy='require' name='vme'/>
Aug 27 03:51:02 user nova-compute[72990]:     <feature policy='require' name='x2apic'/>
Aug 27 03:51:02 user nova-compute[72990]:     <feature policy='require' name='hypervisor'/>
Aug 27 03:51:02 user nova-compute[72990]:   </cpu>
Aug 27 03:51:02 user nova-compute[72990]:   <clock offset='utc'>
Aug 27 03:51:02 user nova-compute[72990]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 03:51:02 user nova-compute[72990]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 03:51:02 user nova-compute[72990]:     <timer name='hpet' present='no'/>
Aug 27 03:51:02 user nova-compute[72990]:   </clock>
Aug 27 03:51:02 user nova-compute[72990]:   <on_poweroff>destroy</on_poweroff>
Aug 27 03:51:02 user nova-compute[72990]:   <on_reboot>restart</on_reboot>
Aug 27 03:51:02 user nova-compute[72990]:   <on_crash>destroy</on_crash>
Aug 27 03:51:02 user nova-compute[72990]:   <devices>
Aug 27 03:51:02 user nova-compute[72990]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 03:51:02 user nova-compute[72990]:     <disk type='file' device='disk'>
Aug 27 03:51:02 user nova-compute[72990]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 03:51:02 user nova-compute[72990]:       <source file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk' index='2'/>
Aug 27 03:51:02 user nova-compute[72990]:       <backingStore type='file' index='3'>
Aug 27 03:51:02 user nova-compute[72990]:         <format type='raw'/>
Aug 27 03:51:02 user nova-compute[72990]:         <source file='/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8'/>
Aug 27 03:51:02 user nova-compute[72990]:         <backingStore/>
Aug 27 03:51:02 user nova-compute[72990]:       </backingStore>
Aug 27 03:51:02 user nova-compute[72990]:       <target dev='vda' bus='virtio'/>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='virtio-disk0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </disk>
Aug 27 03:51:02 user nova-compute[72990]:     <disk type='file' device='cdrom'>
Aug 27 03:51:02 user nova-compute[72990]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 03:51:02 user nova-compute[72990]:       <source file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk.config' index='1'/>
Aug 27 03:51:02 user nova-compute[72990]:       <backingStore/>
Aug 27 03:51:02 user nova-compute[72990]:       <target dev='hda' bus='ide'/>
Aug 27 03:51:02 user nova-compute[72990]:       <readonly/>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='ide0-0-0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </disk>
Aug 27 03:51:02 user nova-compute[72990]:     <controller type='usb' index='0' model='none'>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='usb'/>
Aug 27 03:51:02 user nova-compute[72990]:     </controller>
Aug 27 03:51:02 user nova-compute[72990]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='pci.0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </controller>
Aug 27 03:51:02 user nova-compute[72990]:     <controller type='ide' index='0'>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='ide'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 03:51:02 user nova-compute[72990]:     </controller>
Aug 27 03:51:02 user nova-compute[72990]:     <interface type='ethernet'>
Aug 27 03:51:02 user nova-compute[72990]:       <mac address='fa:16:3e:ef:20:06'/>
Aug 27 03:51:02 user nova-compute[72990]:       <target dev='tap84ceee62-cd'/>
Aug 27 03:51:02 user nova-compute[72990]:       <model type='virtio'/>
Aug 27 03:51:02 user nova-compute[72990]:       <mtu size='1442'/>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='net0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </interface>
Aug 27 03:51:02 user nova-compute[72990]:     <serial type='pty'>
Aug 27 03:51:02 user nova-compute[72990]:       <source path='/dev/pts/8'/>
Aug 27 03:51:02 user nova-compute[72990]:       <log file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/console.log' append='off'/>
Aug 27 03:51:02 user nova-compute[72990]:       <target type='isa-serial' port='0'>
Aug 27 03:51:02 user nova-compute[72990]:         <model name='isa-serial'/>
Aug 27 03:51:02 user nova-compute[72990]:       </target>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='serial0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </serial>
Aug 27 03:51:02 user nova-compute[72990]:     <console type='pty' tty='/dev/pts/8'>
Aug 27 03:51:02 user nova-compute[72990]:       <source path='/dev/pts/8'/>
Aug 27 03:51:02 user nova-compute[72990]:       <log file='/opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/console.log' append='off'/>
Aug 27 03:51:02 user nova-compute[72990]:       <target type='serial' port='0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='serial0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </console>
Aug 27 03:51:02 user nova-compute[72990]:     <input type='mouse' bus='ps2'>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='input0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </input>
Aug 27 03:51:02 user nova-compute[72990]:     <input type='keyboard' bus='ps2'>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='input1'/>
Aug 27 03:51:02 user nova-compute[72990]:     </input>
Aug 27 03:51:02 user nova-compute[72990]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 27 03:51:02 user nova-compute[72990]:       <listen type='address' address='0.0.0.0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </graphics>
Aug 27 03:51:02 user nova-compute[72990]:     <audio id='1' type='none'/>
Aug 27 03:51:02 user nova-compute[72990]:     <video>
Aug 27 03:51:02 user nova-compute[72990]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='video0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </video>
Aug 27 03:51:02 user nova-compute[72990]:     <memballoon model='virtio'>
Aug 27 03:51:02 user nova-compute[72990]:       <stats period='10'/>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='balloon0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </memballoon>
Aug 27 03:51:02 user nova-compute[72990]:     <rng model='virtio'>
Aug 27 03:51:02 user nova-compute[72990]:       <backend model='random'>/dev/urandom</backend>
Aug 27 03:51:02 user nova-compute[72990]:       <alias name='rng0'/>
Aug 27 03:51:02 user nova-compute[72990]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 03:51:02 user nova-compute[72990]:     </rng>
Aug 27 03:51:02 user nova-compute[72990]:   </devices>
Aug 27 03:51:02 user nova-compute[72990]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 03:51:02 user nova-compute[72990]:     <label>libvirt-f2c7f4ed-0c08-4bd8-8386-3830b33a2564</label>
Aug 27 03:51:02 user nova-compute[72990]:     <imagelabel>libvirt-f2c7f4ed-0c08-4bd8-8386-3830b33a2564</imagelabel>
Aug 27 03:51:02 user nova-compute[72990]:   </seclabel>
Aug 27 03:51:02 user nova-compute[72990]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 03:51:02 user nova-compute[72990]:     <label>+64055:+108</label>
Aug 27 03:51:02 user nova-compute[72990]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 03:51:02 user nova-compute[72990]:   </seclabel>
Aug 27 03:51:02 user nova-compute[72990]: </domain>
Aug 27 03:51:02 user nova-compute[72990]:  {{(pid=72990) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 03:51:02 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Detaching interface fa:16:3e:01:ec:9f failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap98f21bd1-d0' not found.
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-212175205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-212175205',id=20,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp5iBc6mdgWaggg8GPI462w6II2N5RXXCb7cdBNB2ye3sojol5LvoVHu+BZkBNjSsdZnceTMdoaxLj46rXSeiRp/G2O9qGXI+h1ydtY+K0cIAqh7rlTCqTWWaEgArwZNw==',key_name='tempest-keypair-1954013112',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9300e35c8184397bcb840a58209d97c',ramdisk_id='',reservation_id='r-w1471yyo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2065968082',owner_user_name='tempest-TaggedAttachmentsTest-2065968082-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2908a9f30c314839abec26c49028f756',uuid=f2c7f4ed-0c08-4bd8-8386-3830b33a2564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.network.os_vif_util [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] Converting VIF {"id": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "address": "fa:16:3e:01:ec:9f", "network": {"id": "381f95fd-80cf-4633-a1b8-da03f10eb242", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-304595890", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f21bd1-d0", "ovs_interfaceid": "98f21bd1-d0d9-4e27-8ee4-d3b9784974b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.network.os_vif_util [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=98f21bd1-d0d9-4e27-8ee4-d3b9784974b4,network=Network(381f95fd-80cf-4633-a1b8-da03f10eb242),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f21bd1-d0') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG os_vif [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=98f21bd1-d0d9-4e27-8ee4-d3b9784974b4,network=Network(381f95fd-80cf-4633-a1b8-da03f10eb242),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f21bd1-d0') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98f21bd1-d0, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:51:02 user nova-compute[72990]: INFO os_vif [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=98f21bd1-d0d9-4e27-8ee4-d3b9784974b4,network=Network(381f95fd-80cf-4633-a1b8-da03f10eb242),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f21bd1-d0')
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [req-649c9f31-7c42-404e-a514-1b560e6b8c1c req-19b42dfa-a2d6-423f-8400-01cd81fc881a service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:51:02 user nova-compute[72990]:   <nova:package version="0.0.0"/>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:name>tempest-device-tagging-server-212175205</nova:name>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:creationTime>2023-08-27 03:51:02</nova:creationTime>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:flavor name="m1.tiny">
Aug 27 03:51:02 user nova-compute[72990]:     <nova:memory>512</nova:memory>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:disk>1</nova:disk>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:swap>0</nova:swap>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:vcpus>1</nova:vcpus>
Aug 27 03:51:02 user nova-compute[72990]:   </nova:flavor>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:owner>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:user uuid="2908a9f30c314839abec26c49028f756">tempest-TaggedAttachmentsTest-2065968082-project-member</nova:user>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:project uuid="f9300e35c8184397bcb840a58209d97c">tempest-TaggedAttachmentsTest-2065968082</nova:project>
Aug 27 03:51:02 user nova-compute[72990]:   </nova:owner>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:51:02 user nova-compute[72990]:   <nova:ports>
Aug 27 03:51:02 user nova-compute[72990]:     <nova:port uuid="84ceee62-cd25-4a7f-b1e5-4e327e56d019">
Aug 27 03:51:02 user nova-compute[72990]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 03:51:02 user nova-compute[72990]:     </nova:port>
Aug 27 03:51:02 user nova-compute[72990]:   </nova:ports>
Aug 27 03:51:02 user nova-compute[72990]: </nova:instance>
Aug 27 03:51:02 user nova-compute[72990]:  {{(pid=72990) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG nova.network.neutron [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updating instance_info_cache with network_info: [{"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Releasing lock "refresh_cache-f2c7f4ed-0c08-4bd8-8386-3830b33a2564" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:51:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fec0c879-cf53-40df-9e7b-049116a5ddbe tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "interface-f2c7f4ed-0c08-4bd8-8386-3830b33a2564-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.760s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:03 user nova-compute[72990]: DEBUG nova.compute.manager [req-fbb12a1a-2f26-4689-a5bb-98fd069fd299 req-4119f862-e569-4a45-8789-88aebe6d1b78 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-vif-plugged-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fbb12a1a-2f26-4689-a5bb-98fd069fd299 req-4119f862-e569-4a45-8789-88aebe6d1b78 service nova] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fbb12a1a-2f26-4689-a5bb-98fd069fd299 req-4119f862-e569-4a45-8789-88aebe6d1b78 service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fbb12a1a-2f26-4689-a5bb-98fd069fd299 req-4119f862-e569-4a45-8789-88aebe6d1b78 service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:03 user nova-compute[72990]: DEBUG nova.compute.manager [req-fbb12a1a-2f26-4689-a5bb-98fd069fd299 req-4119f862-e569-4a45-8789-88aebe6d1b78 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] No waiting events found dispatching network-vif-plugged-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:03 user nova-compute[72990]: WARNING nova.compute.manager [req-fbb12a1a-2f26-4689-a5bb-98fd069fd299 req-4119f862-e569-4a45-8789-88aebe6d1b78 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received unexpected event network-vif-plugged-98f21bd1-d0d9-4e27-8ee4-d3b9784974b4 for instance with vm_state active and task_state None.
Aug 27 03:51:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZCohYIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:51:07 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:51:07 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:51:07 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2862a607-d2d9-42a0-8144-dfc5d7a4caa4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:51:07 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad057d30-c329-4e49-b8f8-bf91b220b51e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128] added
Aug 27 03:51:07 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f47155-af8f-4ded-82f8-96202e3deeb4]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f873eced-abde-4f4e-b1a3-e180a5a2ce46]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fZCohYIP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fZCohYIP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f2491a-4fe2-4f77-ae9e-592fe28c60ff]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fZCohYIP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[43675c27-752d-4b09-8e80-736ecddf5b57]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80d08b1-6b97-47dd-ae21-055e635957ae]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:51:07 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:51:07 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f1009b-6983-45b8-b17a-a7dc48f0f145]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128, portal: 172.16.0.220,3260]
Aug 27 03:51:07 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128, portal: 172.16.0.220,3260] successful.
Aug 27 03:51:07 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a35c247-a13a-4130-859b-c68b300b4fd6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[895dc5a8-7029-46e1-bb41-759cd88fb53b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:07 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:51:07 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:07 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc8f621-5f82-4fbf-9b6d-2831d766a8ad]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:51:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZCohYIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:51:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:51:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23030333163323862', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:51:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030333163323862', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:51:08 user nova-compute[72990]: DEBUG nova.objects.instance [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'flavor' on Instance uuid 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:51:08 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:51:08 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:51:08 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:51:08 user nova-compute[72990]:   <serial>a40d71b0-dac1-41f5-af3d-df8a97ff5128</serial>
Aug 27 03:51:08 user nova-compute[72990]: </disk>
Aug 27 03:51:08 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:51:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:51:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:51:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No VIF found with MAC fa:16:3e:36:a6:b0, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:51:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eab8c2bf-7dfa-442d-8d7b-7f778fd33981 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "15a88698-88d1-4c6b-9e40-98b618978a33" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.426s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:10 user nova-compute[72990]: INFO nova.compute.manager [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Rescuing
Aug 27 03:51:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:51:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquired lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:51:10 user nova-compute[72990]: DEBUG nova.network.neutron [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:51:10 user nova-compute[72990]: DEBUG nova.network.neutron [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updating instance_info_cache with network_info: [{"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Releasing lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:11 user nova-compute[72990]: INFO nova.compute.manager [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Terminating instance
Aug 27 03:51:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-0db77e17-6f06-400d-8676-a1431815393c req-49667d4e-9f3e-49e7-83da-3df653a14c82 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-unplugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0db77e17-6f06-400d-8676-a1431815393c req-49667d4e-9f3e-49e7-83da-3df653a14c82 service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0db77e17-6f06-400d-8676-a1431815393c req-49667d4e-9f3e-49e7-83da-3df653a14c82 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0db77e17-6f06-400d-8676-a1431815393c req-49667d4e-9f3e-49e7-83da-3df653a14c82 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-0db77e17-6f06-400d-8676-a1431815393c req-49667d4e-9f3e-49e7-83da-3df653a14c82 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-unplugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:11 user nova-compute[72990]: WARNING nova.compute.manager [req-0db77e17-6f06-400d-8676-a1431815393c req-49667d4e-9f3e-49e7-83da-3df653a14c82 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-unplugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state active and task_state rescuing.
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Instance destroyed successfully.
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.objects.instance [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'resources' on Instance uuid 1e81de88-259e-4124-8e2c-cafd310a9b42 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Instance destroyed successfully.
Aug 27 03:51:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Attempting rescue
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72990) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:44:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-540718096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-540718096',id=16,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT6IrDqHUyj+WWqRbXtufrlRqRkgo3D56ibga6nfxeKOdSyMT8pY8NCJaScOf+GpkgEwVia9hfEYPOo+O3C0AiPNser5LSpeMDp9MmOv0BFJxJBFs/HXMLQxNaegz6f0w==',key_name='tempest-keypair-1260377371',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:48:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd44d92dded643eb89d955dbf6b4d1e3',ramdisk_id='',reservation_id='r-s07xb5he',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2085503517',owner_user_name='tempest-AttachVolumeShelveTestJSON-2085503517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be8e872f1de4248a557155ff1c4f5ec',uuid=1e81de88-259e-4124-8e2c-cafd310a9b42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converting VIF {"id": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "address": "fa:16:3e:e1:25:a5", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf875fdb9-c3", "ovs_interfaceid": "f875fdb9-c314-4ded-9793-cb49e10bbdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG os_vif [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf875fdb9-c3, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Instance directory exists: not creating {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 03:51:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Creating image(s)
Aug 27 03:51:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "/opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "/opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "/opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.objects.instance [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'trusted_certs' on Instance uuid 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:12 user nova-compute[72990]: INFO os_vif [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=f875fdb9-c314-4ded-9793-cb49e10bbdd8,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf875fdb9-c3')
Aug 27 03:51:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Deleting instance files /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42_del
Aug 27 03:51:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Deletion of /opt/stack/data/nova/instances/1e81de88-259e-4124-8e2c-cafd310a9b42_del complete
Aug 27 03:51:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:12 user nova-compute[72990]: INFO nova.compute.manager [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 27 03:51:12 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.rescue {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.rescue" returned: 0 in 0.056s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.objects.instance [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'migration_context' on Instance uuid 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.objects.base [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<15a88698-88d1-4c6b-9e40-98b618978a33> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Start _get_guest_xml network_info=[{"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "vif_mac": "fa:16:3e:36:a6:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.objects.instance [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'resources' on Instance uuid 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.objects.base [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<15a88698-88d1-4c6b-9e40-98b618978a33> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.objects.instance [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'numa_topology' on Instance uuid 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.objects.base [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<15a88698-88d1-4c6b-9e40-98b618978a33> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:51:12 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:51:12 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.objects.instance [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'vcpu_model' on Instance uuid 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.objects.base [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<15a88698-88d1-4c6b-9e40-98b618978a33> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-931752626',display_name='tempest-ServerRescueNegativeTestJSON-server-931752626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-931752626',id=22,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0KVWF1WU6AFtBbBFdWiBdRcaer72AgRt0JV3tBDQqpR+utjPDLU9VGe36YKFhIncVurAQDbGkNQcA/aRjuUqCaWieSIs1x5jzh2ZRbb1KrdmRyCMe/3f0ttjSiAlwhig==',key_name='tempest-keypair-1761284820',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:49:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='567ed48c72c547c6984851d6ba37e780',ramdisk_id='',reservation_id='r-92ss61f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-311406621',owner_user_name='tempest-ServerRescueNegativeTestJSON-311406621-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0631ab8ad8648e2912d4e554fbbe195',uuid=15a88698-88d1-4c6b-9e40-98b618978a33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "vif_mac": "fa:16:3e:36:a6:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converting VIF {"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "vif_mac": "fa:16:3e:36:a6:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=1344eed9-36fe-4fce-a572-94a310f2d618,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344eed9-36') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.objects.instance [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'pci_devices' on Instance uuid 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.objects.base [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Object Instance<15a88698-88d1-4c6b-9e40-98b618978a33> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:51:12 user nova-compute[72990]:   <uuid>15a88698-88d1-4c6b-9e40-98b618978a33</uuid>
Aug 27 03:51:12 user nova-compute[72990]:   <name>instance-00000016</name>
Aug 27 03:51:12 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:51:12 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:51:12 user nova-compute[72990]:   <metadata>
Aug 27 03:51:12 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:51:12 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:51:12 user nova-compute[72990]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-931752626</nova:name>
Aug 27 03:51:12 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:51:12</nova:creationTime>
Aug 27 03:51:12 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:51:12 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:51:12 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:51:12 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:51:12 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:51:12 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:51:12 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:51:12 user nova-compute[72990]:       <nova:owner>
Aug 27 03:51:12 user nova-compute[72990]:         <nova:user uuid="f0631ab8ad8648e2912d4e554fbbe195">tempest-ServerRescueNegativeTestJSON-311406621-project-member</nova:user>
Aug 27 03:51:12 user nova-compute[72990]:         <nova:project uuid="567ed48c72c547c6984851d6ba37e780">tempest-ServerRescueNegativeTestJSON-311406621</nova:project>
Aug 27 03:51:12 user nova-compute[72990]:       </nova:owner>
Aug 27 03:51:12 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:51:12 user nova-compute[72990]:       <nova:ports>
Aug 27 03:51:12 user nova-compute[72990]:         <nova:port uuid="1344eed9-36fe-4fce-a572-94a310f2d618">
Aug 27 03:51:12 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 03:51:12 user nova-compute[72990]:         </nova:port>
Aug 27 03:51:12 user nova-compute[72990]:       </nova:ports>
Aug 27 03:51:12 user nova-compute[72990]:     </nova:instance>
Aug 27 03:51:12 user nova-compute[72990]:   </metadata>
Aug 27 03:51:12 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:51:12 user nova-compute[72990]:     <system>
Aug 27 03:51:12 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:51:12 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:51:12 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:51:12 user nova-compute[72990]:       <entry name="serial">15a88698-88d1-4c6b-9e40-98b618978a33</entry>
Aug 27 03:51:12 user nova-compute[72990]:       <entry name="uuid">15a88698-88d1-4c6b-9e40-98b618978a33</entry>
Aug 27 03:51:12 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:51:12 user nova-compute[72990]:     </system>
Aug 27 03:51:12 user nova-compute[72990]:   </sysinfo>
Aug 27 03:51:12 user nova-compute[72990]:   <os>
Aug 27 03:51:12 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:51:12 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:51:12 user nova-compute[72990]:   </os>
Aug 27 03:51:12 user nova-compute[72990]:   <features>
Aug 27 03:51:12 user nova-compute[72990]:     <acpi/>
Aug 27 03:51:12 user nova-compute[72990]:     <apic/>
Aug 27 03:51:12 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:51:12 user nova-compute[72990]:   </features>
Aug 27 03:51:12 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:51:12 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:51:12 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:51:12 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:51:12 user nova-compute[72990]:   </clock>
Aug 27 03:51:12 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:51:12 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:51:12 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:51:12 user nova-compute[72990]:   </cpu>
Aug 27 03:51:12 user nova-compute[72990]:   <devices>
Aug 27 03:51:12 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:51:12 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:51:12 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.rescue"/>
Aug 27 03:51:12 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:51:12 user nova-compute[72990]:     </disk>
Aug 27 03:51:12 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:51:12 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:51:12 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk"/>
Aug 27 03:51:12 user nova-compute[72990]:       <target dev="vdb" bus="virtio"/>
Aug 27 03:51:12 user nova-compute[72990]:     </disk>
Aug 27 03:51:12 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:51:12 user nova-compute[72990]:       <mac address="fa:16:3e:36:a6:b0"/>
Aug 27 03:51:12 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:51:12 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:51:12 user nova-compute[72990]:       <target dev="tap1344eed9-36"/>
Aug 27 03:51:12 user nova-compute[72990]:     </interface>
Aug 27 03:51:12 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:51:12 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/console.log" append="off"/>
Aug 27 03:51:12 user nova-compute[72990]:     </serial>
Aug 27 03:51:12 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:51:12 user nova-compute[72990]:     <video>
Aug 27 03:51:12 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:51:12 user nova-compute[72990]:     </video>
Aug 27 03:51:12 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:51:12 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:51:12 user nova-compute[72990]:     </rng>
Aug 27 03:51:12 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:51:12 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:51:12 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:51:12 user nova-compute[72990]:     </memballoon>
Aug 27 03:51:12 user nova-compute[72990]:   </devices>
Aug 27 03:51:12 user nova-compute[72990]: </domain>
Aug 27 03:51:12 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:51:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Instance destroyed successfully.
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:51:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] No VIF found with MAC fa:16:3e:36:a6:b0, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:13 user nova-compute[72990]: WARNING nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state active and task_state rescuing.
Aug 27 03:51:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-vif-unplugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] No waiting events found dispatching network-vif-unplugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-vif-unplugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Acquiring lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] No waiting events found dispatching network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:13 user nova-compute[72990]: WARNING nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received unexpected event network-vif-plugged-f875fdb9-c314-4ded-9793-cb49e10bbdd8 for instance with vm_state active and task_state deleting.
Aug 27 03:51:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:13 user nova-compute[72990]: WARNING nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state active and task_state rescuing.
Aug 27 03:51:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:13 user nova-compute[72990]: WARNING nova.compute.manager [req-a3860ce8-01d5-4c2b-92aa-ee6893142e8f req-ccb14d16-20f7-4db9-a2a3-c4f224c37383 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state active and task_state rescuing.
Aug 27 03:51:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:13 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Took 1.53 seconds to deallocate network for instance.
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:14 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:51:14 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:51:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:14 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Deleted allocations for instance 1e81de88-259e-4124-8e2c-cafd310a9b42
Aug 27 03:51:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-80146f56-dece-4b33-86fe-2d55652b8926 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "1e81de88-259e-4124-8e2c-cafd310a9b42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.441s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-2e2cfe62-d8ea-46d7-9f7e-5b0bd2fe37db req-24dc308a-7765-46a4-87a8-43de7da83e26 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event network-changed-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-2e2cfe62-d8ea-46d7-9f7e-5b0bd2fe37db req-24dc308a-7765-46a4-87a8-43de7da83e26 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Refreshing instance network info cache due to event network-changed-8682c013-92cc-4a9a-bb77-a69abc07cd0c. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2e2cfe62-d8ea-46d7-9f7e-5b0bd2fe37db req-24dc308a-7765-46a4-87a8-43de7da83e26 service nova] Acquiring lock "refresh_cache-c540f8c5-8827-4991-bee7-e2fce0c2d978" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2e2cfe62-d8ea-46d7-9f7e-5b0bd2fe37db req-24dc308a-7765-46a4-87a8-43de7da83e26 service nova] Acquired lock "refresh_cache-c540f8c5-8827-4991-bee7-e2fce0c2d978" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.network.neutron [req-2e2cfe62-d8ea-46d7-9f7e-5b0bd2fe37db req-24dc308a-7765-46a4-87a8-43de7da83e26 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Refreshing network info cache for port 8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-unplugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-unplugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:15 user nova-compute[72990]: WARNING nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-unplugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state active and task_state rescuing.
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Received event network-vif-deleted-f875fdb9-c314-4ded-9793-cb49e10bbdd8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:15 user nova-compute[72990]: WARNING nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state active and task_state rescuing.
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:15 user nova-compute[72990]: WARNING nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state active and task_state rescuing.
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:15 user nova-compute[72990]: WARNING nova.compute.manager [req-0a7ab4b3-8f35-4ac7-bafa-42d6e5423116 req-fc2728d2-2214-4037-9308-99a5a3868cbb service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state active and task_state rescuing.
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.network.neutron [req-2e2cfe62-d8ea-46d7-9f7e-5b0bd2fe37db req-24dc308a-7765-46a4-87a8-43de7da83e26 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Updated VIF entry in instance network info cache for port 8682c013-92cc-4a9a-bb77-a69abc07cd0c. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG nova.network.neutron [req-2e2cfe62-d8ea-46d7-9f7e-5b0bd2fe37db req-24dc308a-7765-46a4-87a8-43de7da83e26 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Updating instance_info_cache with network_info: [{"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2e2cfe62-d8ea-46d7-9f7e-5b0bd2fe37db req-24dc308a-7765-46a4-87a8-43de7da83e26 service nova] Releasing lock "refresh_cache-c540f8c5-8827-4991-bee7-e2fce0c2d978" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:51:16 user nova-compute[72990]: INFO nova.compute.manager [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Rebuilding instance
Aug 27 03:51:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:51:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Removed pending event for 15a88698-88d1-4c6b-9e40-98b618978a33 due to event {{(pid=72990) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 03:51:16 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108276.497757, 15a88698-88d1-4c6b-9e40-98b618978a33 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:51:16 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] VM Resumed (Lifecycle Event)
Aug 27 03:51:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-033613ab-6ad2-456c-971f-1a28232bd077 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:51:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:51:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:51:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:16 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 03:51:16 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108276.5023255, 15a88698-88d1-4c6b-9e40-98b618978a33 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:51:16 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] VM Started (Lifecycle Event)
Aug 27 03:51:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:51:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:17 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Instance destroyed successfully.
Aug 27 03:51:17 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Instance destroyed successfully.
Aug 27 03:51:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-908476780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-673714117',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3PAyQeday+k2IVElwpEXGXjfzzJ3SXG/LO6/dnOTC3QPukrFT+NJp9oRqOaHwRI++w7DioJsEXHO6yZTpNitN00RbRTemlQN1FB2LLFWDsMykIWyCtKESzmuLVzHdmnQ==',key_name='tempest-keypair-1971563117',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='062c6a1b8e4e405cb53c04da895064a6',ramdisk_id='',reservation_id='r-adnhkrxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-46885198',owner_user_name='tempest-ServerActionsV293TestJSON-46885198-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:51:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91e477a683a499a93952e484480f4dd',uuid=c540f8c5-8827-4991-bee7-e2fce0c2d978,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Converting VIF {"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_vif [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8682c013-92, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:17 user nova-compute[72990]: INFO os_vif [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92')
Aug 27 03:51:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVFDMfqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:51:17 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f20c07-ce07-48b0-91ee-96def11db55e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-3d7436fc-46bc-4953-96c5-745dd95451b7 req-a81f9605-69de-42da-9d69-f811ab1fada9 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event network-vif-unplugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3d7436fc-46bc-4953-96c5-745dd95451b7 req-a81f9605-69de-42da-9d69-f811ab1fada9 service nova] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3d7436fc-46bc-4953-96c5-745dd95451b7 req-a81f9605-69de-42da-9d69-f811ab1fada9 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3d7436fc-46bc-4953-96c5-745dd95451b7 req-a81f9605-69de-42da-9d69-f811ab1fada9 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-3d7436fc-46bc-4953-96c5-745dd95451b7 req-a81f9605-69de-42da-9d69-f811ab1fada9 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] No waiting events found dispatching network-vif-unplugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:17 user nova-compute[72990]: WARNING nova.compute.manager [req-3d7436fc-46bc-4953-96c5-745dd95451b7 req-a81f9605-69de-42da-9d69-f811ab1fada9 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received unexpected event network-vif-unplugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c for instance with vm_state active and task_state rebuilding.
Aug 27 03:51:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-3d7436fc-46bc-4953-96c5-745dd95451b7 req-a81f9605-69de-42da-9d69-f811ab1fada9 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3d7436fc-46bc-4953-96c5-745dd95451b7 req-a81f9605-69de-42da-9d69-f811ab1fada9 service nova] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3d7436fc-46bc-4953-96c5-745dd95451b7 req-a81f9605-69de-42da-9d69-f811ab1fada9 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3d7436fc-46bc-4953-96c5-745dd95451b7 req-a81f9605-69de-42da-9d69-f811ab1fada9 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-3d7436fc-46bc-4953-96c5-745dd95451b7 req-a81f9605-69de-42da-9d69-f811ab1fada9 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] No waiting events found dispatching network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:17 user nova-compute[72990]: WARNING nova.compute.manager [req-3d7436fc-46bc-4953-96c5-745dd95451b7 req-a81f9605-69de-42da-9d69-f811ab1fada9 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received unexpected event network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c for instance with vm_state active and task_state rebuilding.
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b172d3b3-6949-46cd-a24c-53e2bf8c220f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:17 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:17 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7237e05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0'): ({'sdd'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Removing single pathed devices sdd {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a018e1c9-cd0c-490f-8593-a65d58d4def9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[794c5602-fc20-451f-91d7-642eed45da4b]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Flushing IO for device /dev/sdd {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfc91ed-ed20-4d67-b857-0efe45ab7d9f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[478631a3-afcf-4083-b588-dd1a8e91b4b7]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23561656536623233', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c45a7521', '/dev/disk/by-id/scsi-1SCST_BIOc45a7521-5aee6b23c8967c1e') {{(pid=84652) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e81a859-d559-4a44-a069-af418f219311]: (4, None) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[171936e3-538a-4a5f-8959-54876a49f1ad]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d480d571-4450-4a1c-9027-3076a894cab1]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260]
Aug 27 03:51:17 user nova-compute[72990]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260] successful.
Aug 27 03:51:17 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b1f7b5-84b2-44af-a1e6-8e19a13d0038]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] <== disconnect_volume: return (366ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:51:17 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Deleting instance files /opt/stack/data/nova/instances/c540f8c5-8827-4991-bee7-e2fce0c2d978_del
Aug 27 03:51:17 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Deletion of /opt/stack/data/nova/instances/c540f8c5-8827-4991-bee7-e2fce0c2d978_del complete
Aug 27 03:51:17 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance c540f8c5-8827-4991-bee7-e2fce0c2d978 could not be found.
Aug 27 03:51:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVFDMfqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:51:17 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9153827-8acf-4094-ac16-5abd28822d42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[566ac706-cbe8-4e61-9afb-5880cbd95675]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:17 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:51:17 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:17 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa714232f80>, {}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Disconnecting from: [] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] <== disconnect_volume: return (66ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:51:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:51:18 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Preparing to wait for external event volume-reimaged-3798f977-b6a9-4589-a6a5-b28f7ea136a0 {{(pid=72990) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 27 03:51:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:21 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:51:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 03:51:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] There are 0 instances to clean {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 03:51:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:51:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:51:23 user nova-compute[72990]: INFO nova.compute.claims [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Claim successful on node user
Aug 27 03:51:23 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:51:23 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:51:23 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:51:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:51:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:51:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:51:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:51:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG nova.policy [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e7d2fc4d4204ad38d0d11376de45bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd007a65dbbce40729d2d7a25561a4f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:51:24 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Creating image(s)
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "/opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "/opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk 1073741824" returned: 0 in 0.054s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.211s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG nova.network.neutron [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Successfully created port: 4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Cannot resize image /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Ensure instance console log exists: /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:25 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:51:25 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Successfully updated port: 4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "refresh_cache-a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquired lock "refresh_cache-a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-f41c430a-978a-49d4-bcc1-72ca3b00d041 req-f321bfad-510d-4368-a6a0-ed0bf3532ba5 service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Received event network-changed-4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-f41c430a-978a-49d4-bcc1-72ca3b00d041 req-f321bfad-510d-4368-a6a0-ed0bf3532ba5 service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Refreshing instance network info cache due to event network-changed-4a10f523-8f08-4a62-aceb-64c206940996. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f41c430a-978a-49d4-bcc1-72ca3b00d041 req-f321bfad-510d-4368-a6a0-ed0bf3532ba5 service nova] Acquiring lock "refresh_cache-a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Updating instance_info_cache with network_info: [{"id": "4a10f523-8f08-4a62-aceb-64c206940996", "address": "fa:16:3e:1c:b7:5d", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a10f523-8f", "ovs_interfaceid": "4a10f523-8f08-4a62-aceb-64c206940996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Releasing lock "refresh_cache-a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Instance network_info: |[{"id": "4a10f523-8f08-4a62-aceb-64c206940996", "address": "fa:16:3e:1c:b7:5d", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a10f523-8f", "ovs_interfaceid": "4a10f523-8f08-4a62-aceb-64c206940996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f41c430a-978a-49d4-bcc1-72ca3b00d041 req-f321bfad-510d-4368-a6a0-ed0bf3532ba5 service nova] Acquired lock "refresh_cache-a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-f41c430a-978a-49d4-bcc1-72ca3b00d041 req-f321bfad-510d-4368-a6a0-ed0bf3532ba5 service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Refreshing network info cache for port 4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Start _get_guest_xml network_info=[{"id": "4a10f523-8f08-4a62-aceb-64c206940996", "address": "fa:16:3e:1c:b7:5d", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a10f523-8f", "ovs_interfaceid": "4a10f523-8f08-4a62-aceb-64c206940996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:51:26 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:51:26 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-947241680',display_name='tempest-AttachVolumeNegativeTest-server-947241680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-947241680',id=24,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3JmHVj1/lz5OMpw1A2/JvMQbwGumKMpTMQneI1Zr16KcG1HWkzucFcL/Sqtt81tasQEUDVtXCi+nj4XToswS4oTaNvI5cpZ6lZCLATKmAM2b0YylHMRg4IHK2+qoqCAg==',key_name='tempest-keypair-1412787747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d007a65dbbce40729d2d7a25561a4f91',ramdisk_id='',reservation_id='r-u1abenk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-945598863',owner_user_name='tempest-AttachVolumeNegativeTest-945598863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7d2fc4d4204ad38d0d11376de45bd6',uuid=a0800495-d65a-4cdc-95d7-b0e0d07e3e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a10f523-8f08-4a62-aceb-64c206940996", "address": "fa:16:3e:1c:b7:5d", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a10f523-8f", "ovs_interfaceid": "4a10f523-8f08-4a62-aceb-64c206940996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converting VIF {"id": "4a10f523-8f08-4a62-aceb-64c206940996", "address": "fa:16:3e:1c:b7:5d", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a10f523-8f", "ovs_interfaceid": "4a10f523-8f08-4a62-aceb-64c206940996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b7:5d,bridge_name='br-int',has_traffic_filtering=True,id=4a10f523-8f08-4a62-aceb-64c206940996,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a10f523-8f') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:26 user nova-compute[72990]: DEBUG nova.objects.instance [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'pci_devices' on Instance uuid a0800495-d65a-4cdc-95d7-b0e0d07e3e5d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:51:27 user nova-compute[72990]:   <uuid>a0800495-d65a-4cdc-95d7-b0e0d07e3e5d</uuid>
Aug 27 03:51:27 user nova-compute[72990]:   <name>instance-00000018</name>
Aug 27 03:51:27 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:51:27 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:51:27 user nova-compute[72990]:   <metadata>
Aug 27 03:51:27 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:51:27 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:51:27 user nova-compute[72990]:       <nova:name>tempest-AttachVolumeNegativeTest-server-947241680</nova:name>
Aug 27 03:51:27 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:51:26</nova:creationTime>
Aug 27 03:51:27 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:51:27 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:51:27 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:51:27 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:51:27 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:51:27 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:51:27 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:51:27 user nova-compute[72990]:       <nova:owner>
Aug 27 03:51:27 user nova-compute[72990]:         <nova:user uuid="4e7d2fc4d4204ad38d0d11376de45bd6">tempest-AttachVolumeNegativeTest-945598863-project-member</nova:user>
Aug 27 03:51:27 user nova-compute[72990]:         <nova:project uuid="d007a65dbbce40729d2d7a25561a4f91">tempest-AttachVolumeNegativeTest-945598863</nova:project>
Aug 27 03:51:27 user nova-compute[72990]:       </nova:owner>
Aug 27 03:51:27 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:51:27 user nova-compute[72990]:       <nova:ports>
Aug 27 03:51:27 user nova-compute[72990]:         <nova:port uuid="4a10f523-8f08-4a62-aceb-64c206940996">
Aug 27 03:51:27 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 03:51:27 user nova-compute[72990]:         </nova:port>
Aug 27 03:51:27 user nova-compute[72990]:       </nova:ports>
Aug 27 03:51:27 user nova-compute[72990]:     </nova:instance>
Aug 27 03:51:27 user nova-compute[72990]:   </metadata>
Aug 27 03:51:27 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:51:27 user nova-compute[72990]:     <system>
Aug 27 03:51:27 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:51:27 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:51:27 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:51:27 user nova-compute[72990]:       <entry name="serial">a0800495-d65a-4cdc-95d7-b0e0d07e3e5d</entry>
Aug 27 03:51:27 user nova-compute[72990]:       <entry name="uuid">a0800495-d65a-4cdc-95d7-b0e0d07e3e5d</entry>
Aug 27 03:51:27 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:51:27 user nova-compute[72990]:     </system>
Aug 27 03:51:27 user nova-compute[72990]:   </sysinfo>
Aug 27 03:51:27 user nova-compute[72990]:   <os>
Aug 27 03:51:27 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:51:27 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:51:27 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:51:27 user nova-compute[72990]:   </os>
Aug 27 03:51:27 user nova-compute[72990]:   <features>
Aug 27 03:51:27 user nova-compute[72990]:     <acpi/>
Aug 27 03:51:27 user nova-compute[72990]:     <apic/>
Aug 27 03:51:27 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:51:27 user nova-compute[72990]:   </features>
Aug 27 03:51:27 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:51:27 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:51:27 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:51:27 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:51:27 user nova-compute[72990]:   </clock>
Aug 27 03:51:27 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:51:27 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:51:27 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:51:27 user nova-compute[72990]:   </cpu>
Aug 27 03:51:27 user nova-compute[72990]:   <devices>
Aug 27 03:51:27 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:51:27 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:51:27 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk"/>
Aug 27 03:51:27 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:51:27 user nova-compute[72990]:     </disk>
Aug 27 03:51:27 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:51:27 user nova-compute[72990]:       <mac address="fa:16:3e:1c:b7:5d"/>
Aug 27 03:51:27 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:51:27 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:51:27 user nova-compute[72990]:       <target dev="tap4a10f523-8f"/>
Aug 27 03:51:27 user nova-compute[72990]:     </interface>
Aug 27 03:51:27 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:51:27 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/console.log" append="off"/>
Aug 27 03:51:27 user nova-compute[72990]:     </serial>
Aug 27 03:51:27 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:51:27 user nova-compute[72990]:     <video>
Aug 27 03:51:27 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:51:27 user nova-compute[72990]:     </video>
Aug 27 03:51:27 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:51:27 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:51:27 user nova-compute[72990]:     </rng>
Aug 27 03:51:27 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:51:27 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:51:27 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:51:27 user nova-compute[72990]:     </memballoon>
Aug 27 03:51:27 user nova-compute[72990]:   </devices>
Aug 27 03:51:27 user nova-compute[72990]: </domain>
Aug 27 03:51:27 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-947241680',display_name='tempest-AttachVolumeNegativeTest-server-947241680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-947241680',id=24,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3JmHVj1/lz5OMpw1A2/JvMQbwGumKMpTMQneI1Zr16KcG1HWkzucFcL/Sqtt81tasQEUDVtXCi+nj4XToswS4oTaNvI5cpZ6lZCLATKmAM2b0YylHMRg4IHK2+qoqCAg==',key_name='tempest-keypair-1412787747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d007a65dbbce40729d2d7a25561a4f91',ramdisk_id='',reservation_id='r-u1abenk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-945598863',owner_user_name='tempest-AttachVolumeNegativeTest-945598863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7d2fc4d4204ad38d0d11376de45bd6',uuid=a0800495-d65a-4cdc-95d7-b0e0d07e3e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a10f523-8f08-4a62-aceb-64c206940996", "address": "fa:16:3e:1c:b7:5d", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a10f523-8f", "ovs_interfaceid": "4a10f523-8f08-4a62-aceb-64c206940996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converting VIF {"id": "4a10f523-8f08-4a62-aceb-64c206940996", "address": "fa:16:3e:1c:b7:5d", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a10f523-8f", "ovs_interfaceid": "4a10f523-8f08-4a62-aceb-64c206940996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b7:5d,bridge_name='br-int',has_traffic_filtering=True,id=4a10f523-8f08-4a62-aceb-64c206940996,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a10f523-8f') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG os_vif [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b7:5d,bridge_name='br-int',has_traffic_filtering=True,id=4a10f523-8f08-4a62-aceb-64c206940996,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a10f523-8f') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a10f523-8f, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a10f523-8f, col_values=(('external_ids', {'iface-id': '4a10f523-8f08-4a62-aceb-64c206940996', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:b7:5d', 'vm-uuid': 'a0800495-d65a-4cdc-95d7-b0e0d07e3e5d'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:27 user nova-compute[72990]: INFO os_vif [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b7:5d,bridge_name='br-int',has_traffic_filtering=True,id=4a10f523-8f08-4a62-aceb-64c206940996,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a10f523-8f')
Aug 27 03:51:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No VIF found with MAC fa:16:3e:1c:b7:5d, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108272.1662798, 1e81de88-259e-4124-8e2c-cafd310a9b42 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:51:27 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] VM Stopped (Lifecycle Event)
Aug 27 03:51:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-004669f8-28c5-4b80-963a-6ca248e752e7 None None] [instance: 1e81de88-259e-4124-8e2c-cafd310a9b42] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG nova.network.neutron [req-f41c430a-978a-49d4-bcc1-72ca3b00d041 req-f321bfad-510d-4368-a6a0-ed0bf3532ba5 service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Updated VIF entry in instance network info cache for port 4a10f523-8f08-4a62-aceb-64c206940996. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG nova.network.neutron [req-f41c430a-978a-49d4-bcc1-72ca3b00d041 req-f321bfad-510d-4368-a6a0-ed0bf3532ba5 service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Updating instance_info_cache with network_info: [{"id": "4a10f523-8f08-4a62-aceb-64c206940996", "address": "fa:16:3e:1c:b7:5d", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a10f523-8f", "ovs_interfaceid": "4a10f523-8f08-4a62-aceb-64c206940996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f41c430a-978a-49d4-bcc1-72ca3b00d041 req-f321bfad-510d-4368-a6a0-ed0bf3532ba5 service nova] Releasing lock "refresh_cache-a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:51:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-d60150e2-14ea-4948-a940-eb8668a47f66 req-010c5873-8c17-40cc-a897-1955c155483a service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Received event network-vif-plugged-4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d60150e2-14ea-4948-a940-eb8668a47f66 req-010c5873-8c17-40cc-a897-1955c155483a service nova] Acquiring lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d60150e2-14ea-4948-a940-eb8668a47f66 req-010c5873-8c17-40cc-a897-1955c155483a service nova] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d60150e2-14ea-4948-a940-eb8668a47f66 req-010c5873-8c17-40cc-a897-1955c155483a service nova] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-d60150e2-14ea-4948-a940-eb8668a47f66 req-010c5873-8c17-40cc-a897-1955c155483a service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] No waiting events found dispatching network-vif-plugged-4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:28 user nova-compute[72990]: WARNING nova.compute.manager [req-d60150e2-14ea-4948-a940-eb8668a47f66 req-010c5873-8c17-40cc-a897-1955c155483a service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Received unexpected event network-vif-plugged-4a10f523-8f08-4a62-aceb-64c206940996 for instance with vm_state building and task_state spawning.
Aug 27 03:51:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:51:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.258s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108290.7140987, a0800495-d65a-4cdc-95d7-b0e0d07e3e5d => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:51:30 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] VM Resumed (Lifecycle Event)
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:51:30 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Instance spawned successfully.
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-c79017a8-bf7b-4d5e-998b-24bbb67cabd9 req-99f5e1e9-f993-4516-a4ff-5f2db30dba7c service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Received event network-vif-plugged-4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c79017a8-bf7b-4d5e-998b-24bbb67cabd9 req-99f5e1e9-f993-4516-a4ff-5f2db30dba7c service nova] Acquiring lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c79017a8-bf7b-4d5e-998b-24bbb67cabd9 req-99f5e1e9-f993-4516-a4ff-5f2db30dba7c service nova] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c79017a8-bf7b-4d5e-998b-24bbb67cabd9 req-99f5e1e9-f993-4516-a4ff-5f2db30dba7c service nova] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-c79017a8-bf7b-4d5e-998b-24bbb67cabd9 req-99f5e1e9-f993-4516-a4ff-5f2db30dba7c service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] No waiting events found dispatching network-vif-plugged-4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:30 user nova-compute[72990]: WARNING nova.compute.manager [req-c79017a8-bf7b-4d5e-998b-24bbb67cabd9 req-99f5e1e9-f993-4516-a4ff-5f2db30dba7c service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Received unexpected event network-vif-plugged-4a10f523-8f08-4a62-aceb-64c206940996 for instance with vm_state building and task_state spawning.
Aug 27 03:51:30 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108290.7155018, a0800495-d65a-4cdc-95d7-b0e0d07e3e5d => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:51:30 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] VM Started (Lifecycle Event)
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:30 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:51:30 user nova-compute[72990]: INFO nova.compute.manager [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Took 6.85 seconds to spawn the instance on the hypervisor.
Aug 27 03:51:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:51:31 user nova-compute[72990]: INFO nova.compute.manager [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Took 7.87 seconds to build instance.
Aug 27 03:51:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-af8b0565-cb08-4c45-a9ad-af23ecdbdb3c tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.979s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108277.2091281, c540f8c5-8827-4991-bee7-e2fce0c2d978 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:51:32 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] VM Stopped (Lifecycle Event)
Aug 27 03:51:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c5a14a7b-4f49-42eb-8b07-658ff7fd51ea None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:34 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:51:34 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7466MB free_disk=25.07827377319336GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Applying migration context for instance 338682cb-8c70-49c3-b88c-362e96ec8fb1 as it has an incoming, in-progress migration 0d10db52-1836-4c21-a2c3-94d5708f1566. Migration status is finished {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 03:51:34 user nova-compute[72990]: INFO nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating resource usage from migration 0d10db52-1836-4c21-a2c3-94d5708f1566
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 6a44010b-9a96-4343-a35c-1f212d21e47b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 15a88698-88d1-4c6b-9e40-98b618978a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance c540f8c5-8827-4991-bee7-e2fce0c2d978 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Migration 0d10db52-1836-4c21-a2c3-94d5708f1566 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 338682cb-8c70-49c3-b88c-362e96ec8fb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance a0800495-d65a-4cdc-95d7-b0e0d07e3e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing inventories for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating ProviderTree inventory for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating inventory in ProviderTree for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing aggregate associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, aggregates: None {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing trait associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:51:34 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:51:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:51:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.949s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:35 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:51:36 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:51:36 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:51:36 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:51:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:51:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:51:36 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:51:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:36 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:51:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:51:37 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:51:37 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:51:37 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:51:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Port 09f159e5-8c35-4fa2-a2e9-873634e6a084 binding to destination host user is already ACTIVE {{(pid=72990) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquired lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating instance_info_cache with network_info: [{"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Releasing lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Creating tmpfile /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/tmpypy9qc3a to verify with other compute node that the instance is on the same shared storage. {{(pid=72990) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72990) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance destroyed successfully.
Aug 27 03:51:40 user nova-compute[72990]: DEBUG nova.objects.instance [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lazy-loading 'resources' on Instance uuid 338682cb-8c70-49c3-b88c-362e96ec8fb1 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2048756041',display_name='tempest-ServerActionsTestOtherB-server-2048756041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2048756041',id=18,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvV5/xdIrrMiR/5VLCxhM3KKboDXXvobrXZoxgpQUAOozywbLJ2xsxdUcEhJo7m/5kpTKUpySOn2yAwFLCYDLgNxiCX1IdtXhqxCfcecMFLg6qxM0T/ZTj+kDi4FnruVQ==',key_name='tempest-keypair-1100770948',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:50:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3efa88907cc54e01abeabdfb040a6d23',ramdisk_id='',reservation_id='r-v5k469oe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-862895181',owner_user_name='tempest-ServerActionsTestOtherB-862895181-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f71b8c6ad2624149b3760b97ab8a9e4a',uuid=338682cb-8c70-49c3-b88c-362e96ec8fb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converting VIF {"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_vif [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09f159e5-8c, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:51:40 user nova-compute[72990]: INFO os_vif [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c')
Aug 27 03:51:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knbmSeEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:51:40 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c94dc1-c784-4486-bc3a-968d27d03f1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cedef2-9265-49fb-b7cd-da60f04c1216]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:40 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:40 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:51:40 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:40 user nova-compute[72990]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:40 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:40 user nova-compute[72990]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:51:40 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:40 user nova-compute[72990]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44a0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63fbfbe-908a-4704-9443-2a1c21a34cb7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0073ea6-563e-4aa9-ba24-44ecacfb7d18]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c32b8f2-ec95-49ff-941b-c9ce71cbe3f1]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d5d8c0-a37e-48c7-a0b4-73bc98b7b46d]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce4755f-ba5f-4874-aae1-b369f26f87fd]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6224c774-9421-425f-9e84-aa515243a7aa]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260]
Aug 27 03:51:40 user nova-compute[72990]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260] successful.
Aug 27 03:51:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb69dea-2eec-4f7f-9357-d82f744d3428]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] <== disconnect_volume: return (321ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:51:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:51:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-a2ef7d89-2917-40f6-82b5-73aac48b98b4 req-427f9a6c-e47c-4be3-bdd9-388fb3d1b019 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-unplugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a2ef7d89-2917-40f6-82b5-73aac48b98b4 req-427f9a6c-e47c-4be3-bdd9-388fb3d1b019 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a2ef7d89-2917-40f6-82b5-73aac48b98b4 req-427f9a6c-e47c-4be3-bdd9-388fb3d1b019 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a2ef7d89-2917-40f6-82b5-73aac48b98b4 req-427f9a6c-e47c-4be3-bdd9-388fb3d1b019 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-a2ef7d89-2917-40f6-82b5-73aac48b98b4 req-427f9a6c-e47c-4be3-bdd9-388fb3d1b019 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-unplugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:41 user nova-compute[72990]: WARNING nova.compute.manager [req-a2ef7d89-2917-40f6-82b5-73aac48b98b4 req-427f9a6c-e47c-4be3-bdd9-388fb3d1b019 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-unplugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state resized and task_state resize_reverting.
Aug 27 03:51:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:41 user nova-compute[72990]: DEBUG nova.objects.instance [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lazy-loading 'migration_context' on Instance uuid 338682cb-8c70-49c3-b88c-362e96ec8fb1 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:41 user nova-compute[72990]: DEBUG nova.objects.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Object Instance<338682cb-8c70-49c3-b88c-362e96ec8fb1> lazy-loaded attributes: resources,migration_context {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c req-6c62d28b-e156-40ff-9684-48c5d04f4e65 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event volume-reimaged-3798f977-b6a9-4589-a6a5-b28f7ea136a0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c req-6c62d28b-e156-40ff-9684-48c5d04f4e65 service nova] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c req-6c62d28b-e156-40ff-9684-48c5d04f4e65 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c req-6c62d28b-e156-40ff-9684-48c5d04f4e65 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c req-6c62d28b-e156-40ff-9684-48c5d04f4e65 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Processing event volume-reimaged-3798f977-b6a9-4589-a6a5-b28f7ea136a0 {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.445s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:42 user nova-compute[72990]: INFO nova.virt.block_device [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Booting with volume 3798f977-b6a9-4589-a6a5-b28f7ea136a0 at /dev/vda
Aug 27 03:51:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG os_brick.utils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f90ce82-b5e4-483f-b790-0e678b89a85e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:42 user nova-compute[72990]: INFO nova.compute.manager [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Swapping old allocation on dict_keys(['404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba']) held by migration 0d10db52-1836-4c21-a2c3-94d5708f1566 for instance
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e940b17-5b81-414f-aeb2-b8a8fb5345da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9760e757-738c-462f-9b5f-d1a06427d359]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0178916-dd35-43f2-9291-37fe115abe5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Overwriting current allocation {'allocations': {'404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 29}}, 'project_id': '3efa88907cc54e01abeabdfb040a6d23', 'user_id': 'f71b8c6ad2624149b3760b97ab8a9e4a', 'consumer_generation': 1} on consumer 338682cb-8c70-49c3-b88c-362e96ec8fb1 {{(pid=72990) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:51:42 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5e43c8-1216-4d16-b737-56ac4a332d0d]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG os_brick.utils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Updating existing volume attachment record: ffb0f964-c23c-4c43-b490-90ca2a184119 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquired lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:51:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG nova.network.neutron [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating instance_info_cache with network_info: [{"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Releasing lock "refresh_cache-338682cb-8c70-49c3-b88c-362e96ec8fb1" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG os_brick.utils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[04717f9d-94f8-4d74-b539-a42d9b4513da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa227b3-7520-40b1-84f7-2a2560b5d01e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de673a8-8f1f-4e27-aa92-d05eb22c6302]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[843e69e7-a023-455c-a5a7-d90786222efc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:51:43 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[495262e4-c037-4d77-90d7-8f645e9d982b]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG os_brick.utils [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-18d50c51-c80f-4dfa-9e4a-cd0a48735800 req-922982a6-f58b-487d-b3e4-3de064718064 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-18d50c51-c80f-4dfa-9e4a-cd0a48735800 req-922982a6-f58b-487d-b3e4-3de064718064 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-18d50c51-c80f-4dfa-9e4a-cd0a48735800 req-922982a6-f58b-487d-b3e4-3de064718064 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-18d50c51-c80f-4dfa-9e4a-cd0a48735800 req-922982a6-f58b-487d-b3e4-3de064718064 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-18d50c51-c80f-4dfa-9e4a-cd0a48735800 req-922982a6-f58b-487d-b3e4-3de064718064 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:43 user nova-compute[72990]: WARNING nova.compute.manager [req-18d50c51-c80f-4dfa-9e4a-cd0a48735800 req-922982a6-f58b-487d-b3e4-3de064718064 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state resized and task_state resize_reverting.
Aug 27 03:51:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "aa475371-4888-4c4b-9b74-4e813b804da6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:51:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:51:50 user nova-compute[72990]: INFO nova.compute.claims [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Claim successful on node user
Aug 27 03:51:51 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG nova.network.neutron [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:51:51 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:51:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:51:51 user nova-compute[72990]: INFO nova.virt.block_device [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Booting with volume c9c9a333-ea9b-467b-9f8d-8579cc71b083 at /dev/vda
Aug 27 03:51:51 user nova-compute[72990]: DEBUG nova.policy [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2aa172fbf7844d390e285244a4f3799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35b53f8f3359444bbc0ef845387a827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG os_brick.utils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceed1b4-c904-4e57-8b4e-80794ab0f4a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32ac00a-11fe-4887-a3ab-c6458b9aaea9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac3206e-bce6-4035-8337-341afb3d702a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c3c343-8dd3-4d91-b812-fd12982061f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:51:51 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:51:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0920d74-4de6-41de-8e79-1cf7f35a942c]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG os_brick.utils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:51:51 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updating existing volume attachment record: 16519d77-ec82-4a8a-9720-06615b90020c {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:51:52 user nova-compute[72990]: DEBUG nova.network.neutron [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Successfully created port: 47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:51:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:52 user nova-compute[72990]: DEBUG nova.network.neutron [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Successfully updated port: 47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquired lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG nova.network.neutron [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-2b51d163-0c7f-4752-9711-7caf58093464 req-fb1c9b4e-ac83-40f7-ae09-6ccf0c49c406 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-changed-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-2b51d163-0c7f-4752-9711-7caf58093464 req-fb1c9b4e-ac83-40f7-ae09-6ccf0c49c406 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Refreshing instance network info cache due to event network-changed-47395266-6458-4699-96ce-7a0d176dc6ac. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2b51d163-0c7f-4752-9711-7caf58093464 req-fb1c9b4e-ac83-40f7-ae09-6ccf0c49c406 service nova] Acquiring lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG nova.network.neutron [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG nova.network.neutron [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updating instance_info_cache with network_info: [{"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Releasing lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Instance network_info: |[{"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2b51d163-0c7f-4752-9711-7caf58093464 req-fb1c9b4e-ac83-40f7-ae09-6ccf0c49c406 service nova] Acquired lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG nova.network.neutron [req-2b51d163-0c7f-4752-9711-7caf58093464 req-fb1c9b4e-ac83-40f7-ae09-6ccf0c49c406 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Refreshing network info cache for port 47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG nova.network.neutron [req-2b51d163-0c7f-4752-9711-7caf58093464 req-fb1c9b4e-ac83-40f7-ae09-6ccf0c49c406 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updated VIF entry in instance network info cache for port 47395266-6458-4699-96ce-7a0d176dc6ac. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG nova.network.neutron [req-2b51d163-0c7f-4752-9711-7caf58093464 req-fb1c9b4e-ac83-40f7-ae09-6ccf0c49c406 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updating instance_info_cache with network_info: [{"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2b51d163-0c7f-4752-9711-7caf58093464 req-fb1c9b4e-ac83-40f7-ae09-6ccf0c49c406 service nova] Releasing lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:51:55 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Creating image(s)
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Ensure instance console log exists: /opt/stack/data/nova/instances/c540f8c5-8827-4991-bee7-e2fce0c2d978/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Start _get_guest_xml network_info=[{"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'ffb0f964-c23c-4c43-b490-90ca2a184119', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVFDMfqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c540f8c5-8827-4991-bee7-e2fce0c2d978', 'attached_at': '', 'detached_at': '', 'volume_id': '3798f977-b6a9-4589-a6a5-b28f7ea136a0', 'serial': '3798f977-b6a9-4589-a6a5-b28f7ea136a0'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:51:55 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 03:51:55 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.objects.instance [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lazy-loading 'vcpu_model' on Instance uuid c540f8c5-8827-4991-bee7-e2fce0c2d978 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVFDMfqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:51:55 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:51:55 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:51:55 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cc45b0-8049-473b-aa24-07a97fc960f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:51:55 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[625f284e-5714-45b2-b313-908cfdc32fbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0] added
Aug 27 03:51:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aeca5f-aef0-42dd-9ef0-180bbb45dabc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:55 user nova-compute[72990]: INFO nova.compute.manager [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Terminating instance
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3e373c-21af-4bdc-bbc7-34a4ca61d609]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVFDMfqx {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVFDMfqx" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8aa549-129f-4070-8f77-7cffd5460a7e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NVFDMfqx'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9167889f-9e50-44b7-9124-3f368527a52a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[56448ac6-f392-4d9c-8d2f-a43027f157b7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:55 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:55 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:55 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:55 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108300.3735669, 338682cb-8c70-49c3-b88c-362e96ec8fb1 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:51:55 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] VM Stopped (Lifecycle Event)
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5ae60ff6-f8cf-441c-8e7c-aafccc71dde3 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[948954c4-abd2-4c17-8b6e-b78238ec7118]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260]
Aug 27 03:51:55 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260] successful.
Aug 27 03:51:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05c9633-ce09-4309-ae6c-ff76c02e78cd]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1989d3a-dc3b-43b0-a1b3-20d0464426f5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:55 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:55 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:55 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:55 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:55 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:55 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcd5085-a90d-41a9-b923-8b85260c8bef]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVFDMfqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-aea26e53-8d3c-4c97-82e6-5db8c5e2d58f req-bfb169df-f392-419d-ba9f-ed820e006b91 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-vif-unplugged-84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aea26e53-8d3c-4c97-82e6-5db8c5e2d58f req-bfb169df-f392-419d-ba9f-ed820e006b91 service nova] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aea26e53-8d3c-4c97-82e6-5db8c5e2d58f req-bfb169df-f392-419d-ba9f-ed820e006b91 service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aea26e53-8d3c-4c97-82e6-5db8c5e2d58f req-bfb169df-f392-419d-ba9f-ed820e006b91 service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-aea26e53-8d3c-4c97-82e6-5db8c5e2d58f req-bfb169df-f392-419d-ba9f-ed820e006b91 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] No waiting events found dispatching network-vif-unplugged-84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-aea26e53-8d3c-4c97-82e6-5db8c5e2d58f req-bfb169df-f392-419d-ba9f-ed820e006b91 service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-vif-unplugged-84ceee62-cd25-4a7f-b1e5-4e327e56d019 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Starting finish_revert_migration {{(pid=72990) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Start _get_guest_xml network_info=[{"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'c3eb7b53-3e98-4f0e-905a-4c1ce07c80b9', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knbmSeEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '338682cb-8c70-49c3-b88c-362e96ec8fb1', 'attached_at': '2023-08-27T03:51:55.000000', 'detached_at': '', 'volume_id': '0edcdf64-da71-43a8-b27d-b9cc7a7bbeba', 'serial': '0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:51:55 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:51:55 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.objects.instance [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lazy-loading 'vcpu_model' on Instance uuid 338682cb-8c70-49c3-b88c-362e96ec8fb1 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knbmSeEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:51:55 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:51:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:51:56 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Instance destroyed successfully.
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.objects.instance [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lazy-loading 'resources' on Instance uuid f2c7f4ed-0c08-4bd8-8386-3830b33a2564 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-212175205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-212175205',id=20,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp5iBc6mdgWaggg8GPI462w6II2N5RXXCb7cdBNB2ye3sojol5LvoVHu+BZkBNjSsdZnceTMdoaxLj46rXSeiRp/G2O9qGXI+h1ydtY+K0cIAqh7rlTCqTWWaEgArwZNw==',key_name='tempest-keypair-1954013112',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9300e35c8184397bcb840a58209d97c',ramdisk_id='',reservation_id='r-w1471yyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2065968082',owner_user_name='tempest-TaggedAttachmentsTest-2065968082-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2908a9f30c314839abec26c49028f756',uuid=f2c7f4ed-0c08-4bd8-8386-3830b33a2564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converting VIF {"id": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "address": "fa:16:3e:ef:20:06", "network": {"id": "5e2456d4-127a-4834-af38-871e86b1f296", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-468720654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9300e35c8184397bcb840a58209d97c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ceee62-cd", "ovs_interfaceid": "84ceee62-cd25-4a7f-b1e5-4e327e56d019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:20:06,bridge_name='br-int',has_traffic_filtering=True,id=84ceee62-cd25-4a7f-b1e5-4e327e56d019,network=Network(5e2456d4-127a-4834-af38-871e86b1f296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ceee62-cd') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_vif [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:20:06,bridge_name='br-int',has_traffic_filtering=True,id=84ceee62-cd25-4a7f-b1e5-4e327e56d019,network=Network(5e2456d4-127a-4834-af38-871e86b1f296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ceee62-cd') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84ceee62-cd, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:51:56 user nova-compute[72990]: INFO os_vif [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:20:06,bridge_name='br-int',has_traffic_filtering=True,id=84ceee62-cd25-4a7f-b1e5-4e327e56d019,network=Network(5e2456d4-127a-4834-af38-871e86b1f296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ceee62-cd')
Aug 27 03:51:56 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Deleting instance files /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564_del
Aug 27 03:51:56 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Deletion of /opt/stack/data/nova/instances/f2c7f4ed-0c08-4bd8-8386-3830b33a2564_del complete
Aug 27 03:51:56 user nova-compute[72990]: INFO nova.compute.manager [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23561656536623233', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561656536623233', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.756s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:51:56 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:51:56 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[217280d9-98b6-49f2-a8f4-b3e6cc7d3dc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:51:56 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-908476780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-673714117',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3PAyQeday+k2IVElwpEXGXjfzzJ3SXG/LO6/dnOTC3QPukrFT+NJp9oRqOaHwRI++w7DioJsEXHO6yZTpNitN00RbRTemlQN1FB2LLFWDsMykIWyCtKESzmuLVzHdmnQ==',key_name='tempest-keypair-1971563117',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='062c6a1b8e4e405cb53c04da895064a6',ramdisk_id='',reservation_id='r-adnhkrxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-46885198',owner_user_name='tempest-ServerActionsV293TestJSON-46885198-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:51:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91e477a683a499a93952e484480f4dd',uuid=c540f8c5-8827-4991-bee7-e2fce0c2d978,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Converting VIF {"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:51:56 user nova-compute[72990]:   <uuid>c540f8c5-8827-4991-bee7-e2fce0c2d978</uuid>
Aug 27 03:51:56 user nova-compute[72990]:   <name>instance-00000017</name>
Aug 27 03:51:56 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:51:56 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:51:56 user nova-compute[72990]:   <metadata>
Aug 27 03:51:56 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:51:56 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:51:56 user nova-compute[72990]:       <nova:name>tempest-ServerActionsV293TestJSON-server-908476780</nova:name>
Aug 27 03:51:56 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:51:55</nova:creationTime>
Aug 27 03:51:56 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:51:56 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:51:56 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:51:56 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:51:56 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:51:56 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:51:56 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:51:56 user nova-compute[72990]:       <nova:owner>
Aug 27 03:51:56 user nova-compute[72990]:         <nova:user uuid="b91e477a683a499a93952e484480f4dd">tempest-ServerActionsV293TestJSON-46885198-project-member</nova:user>
Aug 27 03:51:56 user nova-compute[72990]:         <nova:project uuid="062c6a1b8e4e405cb53c04da895064a6">tempest-ServerActionsV293TestJSON-46885198</nova:project>
Aug 27 03:51:56 user nova-compute[72990]:       </nova:owner>
Aug 27 03:51:56 user nova-compute[72990]:       <nova:ports>
Aug 27 03:51:56 user nova-compute[72990]:         <nova:port uuid="8682c013-92cc-4a9a-bb77-a69abc07cd0c">
Aug 27 03:51:56 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 03:51:56 user nova-compute[72990]:         </nova:port>
Aug 27 03:51:56 user nova-compute[72990]:       </nova:ports>
Aug 27 03:51:56 user nova-compute[72990]:     </nova:instance>
Aug 27 03:51:56 user nova-compute[72990]:   </metadata>
Aug 27 03:51:56 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:51:56 user nova-compute[72990]:     <system>
Aug 27 03:51:56 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:51:56 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:51:56 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:51:56 user nova-compute[72990]:       <entry name="serial">c540f8c5-8827-4991-bee7-e2fce0c2d978</entry>
Aug 27 03:51:56 user nova-compute[72990]:       <entry name="uuid">c540f8c5-8827-4991-bee7-e2fce0c2d978</entry>
Aug 27 03:51:56 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:51:56 user nova-compute[72990]:     </system>
Aug 27 03:51:56 user nova-compute[72990]:   </sysinfo>
Aug 27 03:51:56 user nova-compute[72990]:   <os>
Aug 27 03:51:56 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:51:56 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:51:56 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:51:56 user nova-compute[72990]:   </os>
Aug 27 03:51:56 user nova-compute[72990]:   <features>
Aug 27 03:51:56 user nova-compute[72990]:     <acpi/>
Aug 27 03:51:56 user nova-compute[72990]:     <apic/>
Aug 27 03:51:56 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:51:56 user nova-compute[72990]:   </features>
Aug 27 03:51:56 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:51:56 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:51:56 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:51:56 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:51:56 user nova-compute[72990]:   </clock>
Aug 27 03:51:56 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:51:56 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:51:56 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:51:56 user nova-compute[72990]:   </cpu>
Aug 27 03:51:56 user nova-compute[72990]:   <devices>
Aug 27 03:51:56 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:51:56 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:51:56 user nova-compute[72990]:       <source dev="/dev/sdc"/>
Aug 27 03:51:56 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:51:56 user nova-compute[72990]:       <serial>3798f977-b6a9-4589-a6a5-b28f7ea136a0</serial>
Aug 27 03:51:56 user nova-compute[72990]:     </disk>
Aug 27 03:51:56 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:51:56 user nova-compute[72990]:       <mac address="fa:16:3e:c7:b6:d4"/>
Aug 27 03:51:56 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:51:56 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:51:56 user nova-compute[72990]:       <target dev="tap8682c013-92"/>
Aug 27 03:51:56 user nova-compute[72990]:     </interface>
Aug 27 03:51:56 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:51:56 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/c540f8c5-8827-4991-bee7-e2fce0c2d978/console.log" append="off"/>
Aug 27 03:51:56 user nova-compute[72990]:     </serial>
Aug 27 03:51:56 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:51:56 user nova-compute[72990]:     <video>
Aug 27 03:51:56 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:51:56 user nova-compute[72990]:     </video>
Aug 27 03:51:56 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:51:56 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:51:56 user nova-compute[72990]:     </rng>
Aug 27 03:51:56 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:51:56 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:51:56 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:51:56 user nova-compute[72990]:     </memballoon>
Aug 27 03:51:56 user nova-compute[72990]:   </devices>
Aug 27 03:51:56 user nova-compute[72990]: </domain>
Aug 27 03:51:56 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-908476780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-673714117',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3PAyQeday+k2IVElwpEXGXjfzzJ3SXG/LO6/dnOTC3QPukrFT+NJp9oRqOaHwRI++w7DioJsEXHO6yZTpNitN00RbRTemlQN1FB2LLFWDsMykIWyCtKESzmuLVzHdmnQ==',key_name='tempest-keypair-1971563117',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='062c6a1b8e4e405cb53c04da895064a6',ramdisk_id='',reservation_id='r-adnhkrxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-46885198',owner_user_name='tempest-ServerActionsV293TestJSON-46885198-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:51:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91e477a683a499a93952e484480f4dd',uuid=c540f8c5-8827-4991-bee7-e2fce0c2d978,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Converting VIF {"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_vif [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb09830-2a22-4eaa-a419-1fe0a4f7af52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba] added
Aug 27 03:51:56 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8682c013-92, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8682c013-92, col_values=(('external_ids', {'iface-id': '8682c013-92cc-4a9a-bb77-a69abc07cd0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:b6:d4', 'vm-uuid': 'c540f8c5-8827-4991-bee7-e2fce0c2d978'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:56 user nova-compute[72990]: INFO os_vif [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92')
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b387ce6f-b5a6-4bc9-b45d-26a3823d69a8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3313030-6235-4cbf-9cbf-27ea00c8be9d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knbmSeEU {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knbmSeEU" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e264dee-b4c2-440e-aea9-7966b999ec17]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'knbmSeEU'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] No VIF found with MAC fa:16:3e:c7:b6:d4, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[500df3bf-5b16-41f8-8ff5-1d6e6f2a3797]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:51:56 user nova-compute[72990]: INFO nova.compute.claims [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Claim successful on node user
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[152e18df-61a8-47c3-9b15-d459c050ab4e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:56 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:56 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[51078deb-452a-4438-87a5-b82e57300004]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260]
Aug 27 03:51:56 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260] successful.
Aug 27 03:51:56 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de47bb3-ac13-4033-9b32-a182eda25bdc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94dc7c2-f710-4381-b7ee-2c4547473649]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:51:56 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:51:56 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:51:56 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[adac1f84-0ffe-4e48-aba0-8c7244a10c82]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:51:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knbmSeEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:57 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Took 0.91 seconds to deallocate network for instance.
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.compute.manager [req-49a380bc-930a-4ddc-ba33-a8b773c18b7a req-18f03da8-4fde-427b-85e3-e2afd397f78d service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-vif-deleted-84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:57 user nova-compute[72990]: INFO nova.compute.manager [req-49a380bc-930a-4ddc-ba33-a8b773c18b7a req-18f03da8-4fde-427b-85e3-e2afd397f78d service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Neutron deleted interface 84ceee62-cd25-4a7f-b1e5-4e327e56d019; detaching it from the instance and deleting it from the info cache
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.network.neutron [req-49a380bc-930a-4ddc-ba33-a8b773c18b7a req-18f03da8-4fde-427b-85e3-e2afd397f78d service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.compute.manager [req-49a380bc-930a-4ddc-ba33-a8b773c18b7a req-18f03da8-4fde-427b-85e3-e2afd397f78d service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Detach interface failed, port_id=84ceee62-cd25-4a7f-b1e5-4e327e56d019, reason: Instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564 could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.140s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:51:57 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:51:57 user nova-compute[72990]: INFO nova.virt.block_device [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Booting with volume-backed-image a49a9f69-b2fa-42fe-942e-afa347d26054 at /dev/vda
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.policy [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '858a63e8d5964f38ad776985cfbe9121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183297ba5b6549fdb39f2135d92b3794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.compute.manager [req-16cc7fe4-9c73-4a08-9a66-e62b54120340 req-9c39ffe2-894c-4d8e-a261-4c6084329cac service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received event network-vif-plugged-84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-16cc7fe4-9c73-4a08-9a66-e62b54120340 req-9c39ffe2-894c-4d8e-a261-4c6084329cac service nova] Acquiring lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-16cc7fe4-9c73-4a08-9a66-e62b54120340 req-9c39ffe2-894c-4d8e-a261-4c6084329cac service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-16cc7fe4-9c73-4a08-9a66-e62b54120340 req-9c39ffe2-894c-4d8e-a261-4c6084329cac service nova] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.compute.manager [req-16cc7fe4-9c73-4a08-9a66-e62b54120340 req-9c39ffe2-894c-4d8e-a261-4c6084329cac service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] No waiting events found dispatching network-vif-plugged-84ceee62-cd25-4a7f-b1e5-4e327e56d019 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:57 user nova-compute[72990]: WARNING nova.compute.manager [req-16cc7fe4-9c73-4a08-9a66-e62b54120340 req-9c39ffe2-894c-4d8e-a261-4c6084329cac service nova] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Received unexpected event network-vif-plugged-84ceee62-cd25-4a7f-b1e5-4e327e56d019 for instance with vm_state deleted and task_state None.
Aug 27 03:51:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:57 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Deleted allocations for instance f2c7f4ed-0c08-4bd8-8386-3830b33a2564
Aug 27 03:51:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b941c5be-8b74-4653-8a36-5b99370a753a tempest-TaggedAttachmentsTest-2065968082 tempest-TaggedAttachmentsTest-2065968082-project-member] Lock "f2c7f4ed-0c08-4bd8-8386-3830b33a2564" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.666s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] <== connect_volume: return (2144ms) {'type': 'block', 'scsi_wwn': '23633386163313466', 'path': '/dev/sdd'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633386163313466', 'path': '/dev/sdd'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2048756041',display_name='tempest-ServerActionsTestOtherB-server-2048756041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2048756041',id=18,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvV5/xdIrrMiR/5VLCxhM3KKboDXXvobrXZoxgpQUAOozywbLJ2xsxdUcEhJo7m/5kpTKUpySOn2yAwFLCYDLgNxiCX1IdtXhqxCfcecMFLg6qxM0T/ZTj+kDi4FnruVQ==',key_name='tempest-keypair-1100770948',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:50:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3efa88907cc54e01abeabdfb040a6d23',ramdisk_id='',reservation_id='r-v5k469oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-862895181',owner_user_name='tempest-ServerActionsTestOtherB-862895181-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:51:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f71b8c6ad2624149b3760b97ab8a9e4a',uuid=338682cb-8c70-49c3-b88c-362e96ec8fb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converting VIF {"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:51:57 user nova-compute[72990]:   <uuid>338682cb-8c70-49c3-b88c-362e96ec8fb1</uuid>
Aug 27 03:51:57 user nova-compute[72990]:   <name>instance-00000012</name>
Aug 27 03:51:57 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:51:57 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:51:57 user nova-compute[72990]:   <metadata>
Aug 27 03:51:57 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:51:57 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:51:57 user nova-compute[72990]:       <nova:name>tempest-ServerActionsTestOtherB-server-2048756041</nova:name>
Aug 27 03:51:57 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:51:55</nova:creationTime>
Aug 27 03:51:57 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:51:57 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:51:57 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:51:57 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:51:57 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:51:57 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:51:57 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:51:57 user nova-compute[72990]:       <nova:owner>
Aug 27 03:51:57 user nova-compute[72990]:         <nova:user uuid="f71b8c6ad2624149b3760b97ab8a9e4a">tempest-ServerActionsTestOtherB-862895181-project-member</nova:user>
Aug 27 03:51:57 user nova-compute[72990]:         <nova:project uuid="3efa88907cc54e01abeabdfb040a6d23">tempest-ServerActionsTestOtherB-862895181</nova:project>
Aug 27 03:51:57 user nova-compute[72990]:       </nova:owner>
Aug 27 03:51:57 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:51:57 user nova-compute[72990]:       <nova:ports>
Aug 27 03:51:57 user nova-compute[72990]:         <nova:port uuid="09f159e5-8c35-4fa2-a2e9-873634e6a084">
Aug 27 03:51:57 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 03:51:57 user nova-compute[72990]:         </nova:port>
Aug 27 03:51:57 user nova-compute[72990]:       </nova:ports>
Aug 27 03:51:57 user nova-compute[72990]:     </nova:instance>
Aug 27 03:51:57 user nova-compute[72990]:   </metadata>
Aug 27 03:51:57 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:51:57 user nova-compute[72990]:     <system>
Aug 27 03:51:57 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:51:57 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:51:57 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:51:57 user nova-compute[72990]:       <entry name="serial">338682cb-8c70-49c3-b88c-362e96ec8fb1</entry>
Aug 27 03:51:57 user nova-compute[72990]:       <entry name="uuid">338682cb-8c70-49c3-b88c-362e96ec8fb1</entry>
Aug 27 03:51:57 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:51:57 user nova-compute[72990]:     </system>
Aug 27 03:51:57 user nova-compute[72990]:   </sysinfo>
Aug 27 03:51:57 user nova-compute[72990]:   <os>
Aug 27 03:51:57 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:51:57 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:51:57 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:51:57 user nova-compute[72990]:   </os>
Aug 27 03:51:57 user nova-compute[72990]:   <features>
Aug 27 03:51:57 user nova-compute[72990]:     <acpi/>
Aug 27 03:51:57 user nova-compute[72990]:     <apic/>
Aug 27 03:51:57 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:51:57 user nova-compute[72990]:   </features>
Aug 27 03:51:57 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:51:57 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:51:57 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:51:57 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:51:57 user nova-compute[72990]:   </clock>
Aug 27 03:51:57 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:51:57 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:51:57 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:51:57 user nova-compute[72990]:   </cpu>
Aug 27 03:51:57 user nova-compute[72990]:   <devices>
Aug 27 03:51:57 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:51:57 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:51:57 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk"/>
Aug 27 03:51:57 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:51:57 user nova-compute[72990]:     </disk>
Aug 27 03:51:57 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:51:57 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:51:57 user nova-compute[72990]:       <source dev="/dev/sdd"/>
Aug 27 03:51:57 user nova-compute[72990]:       <target dev="vdb" bus="virtio"/>
Aug 27 03:51:57 user nova-compute[72990]:       <serial>0edcdf64-da71-43a8-b27d-b9cc7a7bbeba</serial>
Aug 27 03:51:57 user nova-compute[72990]:     </disk>
Aug 27 03:51:57 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:51:57 user nova-compute[72990]:       <mac address="fa:16:3e:94:53:13"/>
Aug 27 03:51:57 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:51:57 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:51:57 user nova-compute[72990]:       <target dev="tap09f159e5-8c"/>
Aug 27 03:51:57 user nova-compute[72990]:     </interface>
Aug 27 03:51:57 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:51:57 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/console.log" append="off"/>
Aug 27 03:51:57 user nova-compute[72990]:     </serial>
Aug 27 03:51:57 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:51:57 user nova-compute[72990]:     <video>
Aug 27 03:51:57 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:51:57 user nova-compute[72990]:     </video>
Aug 27 03:51:57 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:51:57 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:51:57 user nova-compute[72990]:     </rng>
Aug 27 03:51:57 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:51:57 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:51:57 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:51:57 user nova-compute[72990]:     </memballoon>
Aug 27 03:51:57 user nova-compute[72990]:   </devices>
Aug 27 03:51:57 user nova-compute[72990]: </domain>
Aug 27 03:51:57 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2048756041',display_name='tempest-ServerActionsTestOtherB-server-2048756041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2048756041',id=18,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvV5/xdIrrMiR/5VLCxhM3KKboDXXvobrXZoxgpQUAOozywbLJ2xsxdUcEhJo7m/5kpTKUpySOn2yAwFLCYDLgNxiCX1IdtXhqxCfcecMFLg6qxM0T/ZTj+kDi4FnruVQ==',key_name='tempest-keypair-1100770948',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:50:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3efa88907cc54e01abeabdfb040a6d23',ramdisk_id='',reservation_id='r-v5k469oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-862895181',owner_user_name='tempest-ServerActionsTestOtherB-862895181-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:51:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f71b8c6ad2624149b3760b97ab8a9e4a',uuid=338682cb-8c70-49c3-b88c-362e96ec8fb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converting VIF {"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG os_vif [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09f159e5-8c, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09f159e5-8c, col_values=(('external_ids', {'iface-id': '09f159e5-8c35-4fa2-a2e9-873634e6a084', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:53:13', 'vm-uuid': '338682cb-8c70-49c3-b88c-362e96ec8fb1'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:58 user nova-compute[72990]: INFO os_vif [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c')
Aug 27 03:51:58 user nova-compute[72990]: DEBUG nova.compute.manager [req-5975d575-8491-49bd-958e-43057d6dbd49 req-ceeb9cc4-8728-459e-bb94-f97b5c5ef60e service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5975d575-8491-49bd-958e-43057d6dbd49 req-ceeb9cc4-8728-459e-bb94-f97b5c5ef60e service nova] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:51:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5975d575-8491-49bd-958e-43057d6dbd49 req-ceeb9cc4-8728-459e-bb94-f97b5c5ef60e service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:51:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5975d575-8491-49bd-958e-43057d6dbd49 req-ceeb9cc4-8728-459e-bb94-f97b5c5ef60e service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:51:58 user nova-compute[72990]: DEBUG nova.compute.manager [req-5975d575-8491-49bd-958e-43057d6dbd49 req-ceeb9cc4-8728-459e-bb94-f97b5c5ef60e service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] No waiting events found dispatching network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:51:58 user nova-compute[72990]: WARNING nova.compute.manager [req-5975d575-8491-49bd-958e-43057d6dbd49 req-ceeb9cc4-8728-459e-bb94-f97b5c5ef60e service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received unexpected event network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c for instance with vm_state active and task_state rebuild_spawning.
Aug 27 03:51:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:58 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Successfully created port: f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Successfully updated port: f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "refresh_cache-250288e9-5421-4757-9258-fa1cf0c3be2f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquired lock "refresh_cache-250288e9-5421-4757-9258-fa1cf0c3be2f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG nova.compute.manager [req-890387da-acb1-4598-90db-0e798765de0d req-6ab1a191-419c-40e3-9afd-8e3a59c04045 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-changed-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG nova.compute.manager [req-890387da-acb1-4598-90db-0e798765de0d req-6ab1a191-419c-40e3-9afd-8e3a59c04045 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Refreshing instance network info cache due to event network-changed-f92099d9-a8e3-45fa-879a-40a71a5ca301. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-890387da-acb1-4598-90db-0e798765de0d req-6ab1a191-419c-40e3-9afd-8e3a59c04045 service nova] Acquiring lock "refresh_cache-250288e9-5421-4757-9258-fa1cf0c3be2f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Updating instance_info_cache with network_info: [{"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Releasing lock "refresh_cache-250288e9-5421-4757-9258-fa1cf0c3be2f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Instance network_info: |[{"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-890387da-acb1-4598-90db-0e798765de0d req-6ab1a191-419c-40e3-9afd-8e3a59c04045 service nova] Acquired lock "refresh_cache-250288e9-5421-4757-9258-fa1cf0c3be2f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:51:59 user nova-compute[72990]: DEBUG nova.network.neutron [req-890387da-acb1-4598-90db-0e798765de0d req-6ab1a191-419c-40e3-9afd-8e3a59c04045 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Refreshing network info cache for port f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] No waiting events found dispatching network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:52:00 user nova-compute[72990]: WARNING nova.compute.manager [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received unexpected event network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c for instance with vm_state active and task_state rebuild_spawning.
Aug 27 03:52:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:52:00 user nova-compute[72990]: WARNING nova.compute.manager [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state resized and task_state resize_reverting.
Aug 27 03:52:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG nova.compute.manager [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:52:00 user nova-compute[72990]: WARNING nova.compute.manager [req-be05f1e3-4f9a-4442-8773-6ae69e476019 req-03de2f75-dcc9-47d7-81e6-f888adde71c0 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state resized and task_state resize_reverting.
Aug 27 03:52:00 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG nova.network.neutron [req-890387da-acb1-4598-90db-0e798765de0d req-6ab1a191-419c-40e3-9afd-8e3a59c04045 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Updated VIF entry in instance network info cache for port f92099d9-a8e3-45fa-879a-40a71a5ca301. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG nova.network.neutron [req-890387da-acb1-4598-90db-0e798765de0d req-6ab1a191-419c-40e3-9afd-8e3a59c04045 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Updating instance_info_cache with network_info: [{"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:52:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-890387da-acb1-4598-90db-0e798765de0d req-6ab1a191-419c-40e3-9afd-8e3a59c04045 service nova] Releasing lock "refresh_cache-250288e9-5421-4757-9258-fa1cf0c3be2f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108321.339348, c540f8c5-8827-4991-bee7-e2fce0c2d978 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:01 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] VM Resumed (Lifecycle Event)
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:52:01 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Instance spawned successfully.
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:52:01 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108321.3410447, c540f8c5-8827-4991-bee7-e2fce0c2d978 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:01 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] VM Started (Lifecycle Event)
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:52:01 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 03:52:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.objects.instance [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72990) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ed0a9c2-6202-4336-a65d-59f33ccd5f5c tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.081s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108321.9428253, 338682cb-8c70-49c3-b88c-362e96ec8fb1 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:01 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] VM Resumed (Lifecycle Event)
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:52:01 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance running successfully.
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] finish_revert_migration finished successfully. {{(pid=72990) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:52:02 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 27 03:52:02 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108321.948971, 338682cb-8c70-49c3-b88c-362e96ec8fb1 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:02 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] VM Started (Lifecycle Event)
Aug 27 03:52:02 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:02 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:52:02 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 27 03:52:02 user nova-compute[72990]: INFO nova.compute.manager [None req-97b414a6-adea-4353-a0c0-8638e10cdf3f tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating instance to original state: 'active'
Aug 27 03:52:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:52:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:05 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:52:05 user nova-compute[72990]: INFO nova.compute.claims [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Claim successful on node user
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:52:06 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Creating image(s)
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Ensure instance console log exists: /opt/stack/data/nova/instances/aa475371-4888-4c4b-9b74-4e813b804da6/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Start _get_guest_xml network_info=[{"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '16519d77-ec82-4a8a-9720-06615b90020c', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcKDWLfy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa475371-4888-4c4b-9b74-4e813b804da6', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9c9a333-ea9b-467b-9f8d-8579cc71b083', 'serial': 'c9c9a333-ea9b-467b-9f8d-8579cc71b083'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:52:06 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:52:06 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcKDWLfy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:52:06 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:52:06 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:52:06 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c776c1-6066-430c-87d5-3aa34a8f1049]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:52:06 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52369f8-06fd-4bbc-b308-336d8f9b0bae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083] added
Aug 27 03:52:06 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[62786c3d-8860-4e9a-ab9f-5226c6f8a262]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fc9e92-3c46-485e-8d27-74a79478f9b8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcKDWLfy {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcKDWLfy" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a69626a-122b-4ca8-bebc-0fe2e9274b4b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qcKDWLfy'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[451621b5-1f99-4e96-a44e-147809570da5]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77c54d8-c5e6-4e2b-a197-4ed326b0912c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:52:06 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:52:06 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d6d36d-d1da-4387-baf7-6d6b32a79c91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260]
Aug 27 03:52:06 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260] successful.
Aug 27 03:52:06 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b031938f-dfb4-4a05-a3ca-d14acfa800ee]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dcaf0a-9f63-44f1-862a-770fc3fa9b0c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:52:06 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:52:06 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baa5903-e3d8-42f0-8185-123e7c609c44]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.778s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.network.neutron [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:52:06 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:52:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:52:07 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Creating image(s)
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "/opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "/opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.policy [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0be8e872f1de4248a557155ff1c4f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd44d92dded643eb89d955dbf6b4d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.293s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcKDWLfy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '26537333065306661', 'path': '/dev/sde'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537333065306661', 'path': '/dev/sde'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.223s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk 1073741824" returned: 0 in 0.064s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1204888072',display_name='tempest-TestShelveInstance-server-1204888072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1204888072',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODV3Eri2dz2QHD+ZkoRXONy+eMUQH4dVucSwROfVAI7uHKjkcKJQ36vL0D2hVAPAob00hmgbkYOFlwA0UkWtUYMQOIanoWC+2Pla6BWL/YN26BBCZtlxP3wx1JEWrSQ/w==',key_name='tempest-TestShelveInstance-2100279265',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35b53f8f3359444bbc0ef845387a827a',ramdisk_id='',reservation_id='r-lglgy4lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1842874330',owner_user_name='tempest-TestShelveInstance-1842874330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:51:51Z,user_data=None,user_id='e2aa172fbf7844d390e285244a4f3799',uuid=aa475371-4888-4c4b-9b74-4e813b804da6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Converting VIF {"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.objects.instance [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lazy-loading 'pci_devices' on Instance uuid aa475371-4888-4c4b-9b74-4e813b804da6 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:52:07 user nova-compute[72990]:   <uuid>aa475371-4888-4c4b-9b74-4e813b804da6</uuid>
Aug 27 03:52:07 user nova-compute[72990]:   <name>instance-00000019</name>
Aug 27 03:52:07 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:52:07 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:52:07 user nova-compute[72990]:   <metadata>
Aug 27 03:52:07 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:52:07 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:52:07 user nova-compute[72990]:       <nova:name>tempest-TestShelveInstance-server-1204888072</nova:name>
Aug 27 03:52:07 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:52:06</nova:creationTime>
Aug 27 03:52:07 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:52:07 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:52:07 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:52:07 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:52:07 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:52:07 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:52:07 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:52:07 user nova-compute[72990]:       <nova:owner>
Aug 27 03:52:07 user nova-compute[72990]:         <nova:user uuid="e2aa172fbf7844d390e285244a4f3799">tempest-TestShelveInstance-1842874330-project-member</nova:user>
Aug 27 03:52:07 user nova-compute[72990]:         <nova:project uuid="35b53f8f3359444bbc0ef845387a827a">tempest-TestShelveInstance-1842874330</nova:project>
Aug 27 03:52:07 user nova-compute[72990]:       </nova:owner>
Aug 27 03:52:07 user nova-compute[72990]:       <nova:ports>
Aug 27 03:52:07 user nova-compute[72990]:         <nova:port uuid="47395266-6458-4699-96ce-7a0d176dc6ac">
Aug 27 03:52:07 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 03:52:07 user nova-compute[72990]:         </nova:port>
Aug 27 03:52:07 user nova-compute[72990]:       </nova:ports>
Aug 27 03:52:07 user nova-compute[72990]:     </nova:instance>
Aug 27 03:52:07 user nova-compute[72990]:   </metadata>
Aug 27 03:52:07 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:52:07 user nova-compute[72990]:     <system>
Aug 27 03:52:07 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:52:07 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:52:07 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:52:07 user nova-compute[72990]:       <entry name="serial">aa475371-4888-4c4b-9b74-4e813b804da6</entry>
Aug 27 03:52:07 user nova-compute[72990]:       <entry name="uuid">aa475371-4888-4c4b-9b74-4e813b804da6</entry>
Aug 27 03:52:07 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:52:07 user nova-compute[72990]:     </system>
Aug 27 03:52:07 user nova-compute[72990]:   </sysinfo>
Aug 27 03:52:07 user nova-compute[72990]:   <os>
Aug 27 03:52:07 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:52:07 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:52:07 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:52:07 user nova-compute[72990]:   </os>
Aug 27 03:52:07 user nova-compute[72990]:   <features>
Aug 27 03:52:07 user nova-compute[72990]:     <acpi/>
Aug 27 03:52:07 user nova-compute[72990]:     <apic/>
Aug 27 03:52:07 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:52:07 user nova-compute[72990]:   </features>
Aug 27 03:52:07 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:52:07 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:52:07 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:52:07 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:52:07 user nova-compute[72990]:   </clock>
Aug 27 03:52:07 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:52:07 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:52:07 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:52:07 user nova-compute[72990]:   </cpu>
Aug 27 03:52:07 user nova-compute[72990]:   <devices>
Aug 27 03:52:07 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:52:07 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:52:07 user nova-compute[72990]:       <source dev="/dev/sde"/>
Aug 27 03:52:07 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:52:07 user nova-compute[72990]:       <serial>c9c9a333-ea9b-467b-9f8d-8579cc71b083</serial>
Aug 27 03:52:07 user nova-compute[72990]:     </disk>
Aug 27 03:52:07 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:52:07 user nova-compute[72990]:       <mac address="fa:16:3e:66:5d:2f"/>
Aug 27 03:52:07 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:52:07 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:52:07 user nova-compute[72990]:       <target dev="tap47395266-64"/>
Aug 27 03:52:07 user nova-compute[72990]:     </interface>
Aug 27 03:52:07 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:52:07 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/aa475371-4888-4c4b-9b74-4e813b804da6/console.log" append="off"/>
Aug 27 03:52:07 user nova-compute[72990]:     </serial>
Aug 27 03:52:07 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:52:07 user nova-compute[72990]:     <video>
Aug 27 03:52:07 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:52:07 user nova-compute[72990]:     </video>
Aug 27 03:52:07 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:52:07 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:52:07 user nova-compute[72990]:     </rng>
Aug 27 03:52:07 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:52:07 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:52:07 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:52:07 user nova-compute[72990]:     </memballoon>
Aug 27 03:52:07 user nova-compute[72990]:   </devices>
Aug 27 03:52:07 user nova-compute[72990]: </domain>
Aug 27 03:52:07 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1204888072',display_name='tempest-TestShelveInstance-server-1204888072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1204888072',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODV3Eri2dz2QHD+ZkoRXONy+eMUQH4dVucSwROfVAI7uHKjkcKJQ36vL0D2hVAPAob00hmgbkYOFlwA0UkWtUYMQOIanoWC+2Pla6BWL/YN26BBCZtlxP3wx1JEWrSQ/w==',key_name='tempest-TestShelveInstance-2100279265',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35b53f8f3359444bbc0ef845387a827a',ramdisk_id='',reservation_id='r-lglgy4lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1842874330',owner_user_name='tempest-TestShelveInstance-1842874330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:51:51Z,user_data=None,user_id='e2aa172fbf7844d390e285244a4f3799',uuid=aa475371-4888-4c4b-9b74-4e813b804da6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Converting VIF {"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG os_vif [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47395266-64, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47395266-64, col_values=(('external_ids', {'iface-id': '47395266-6458-4699-96ce-7a0d176dc6ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:5d:2f', 'vm-uuid': 'aa475371-4888-4c4b-9b74-4e813b804da6'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:07 user nova-compute[72990]: INFO os_vif [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64')
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] No VIF found with MAC fa:16:3e:66:5d:2f, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.226s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:52:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:08 user nova-compute[72990]: DEBUG nova.network.neutron [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Successfully created port: 778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:52:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:08 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Cannot resize image /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:52:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:52:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Ensure instance console log exists: /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:52:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.network.neutron [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Successfully updated port: 778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquired lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.network.neutron [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-29595ab8-649a-4765-9678-22c2293b1b62 req-fe67914b-9c19-434b-9a4d-fce7d74d7577 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-changed-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-29595ab8-649a-4765-9678-22c2293b1b62 req-fe67914b-9c19-434b-9a4d-fce7d74d7577 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Refreshing instance network info cache due to event network-changed-778be9fb-ea44-464a-b5a7-aea387c1aded. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-29595ab8-649a-4765-9678-22c2293b1b62 req-fe67914b-9c19-434b-9a4d-fce7d74d7577 service nova] Acquiring lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.network.neutron [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-cd4d70b2-2209-4bb6-9deb-8a6cdce46bed req-a71df6c3-01b4-430a-94db-3fd90e799fc6 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cd4d70b2-2209-4bb6-9deb-8a6cdce46bed req-a71df6c3-01b4-430a-94db-3fd90e799fc6 service nova] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cd4d70b2-2209-4bb6-9deb-8a6cdce46bed req-a71df6c3-01b4-430a-94db-3fd90e799fc6 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cd4d70b2-2209-4bb6-9deb-8a6cdce46bed req-a71df6c3-01b4-430a-94db-3fd90e799fc6 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-cd4d70b2-2209-4bb6-9deb-8a6cdce46bed req-a71df6c3-01b4-430a-94db-3fd90e799fc6 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] No waiting events found dispatching network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:52:09 user nova-compute[72990]: WARNING nova.compute.manager [req-cd4d70b2-2209-4bb6-9deb-8a6cdce46bed req-a71df6c3-01b4-430a-94db-3fd90e799fc6 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received unexpected event network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac for instance with vm_state building and task_state spawning.
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.network.neutron [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updating instance_info_cache with network_info: [{"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Releasing lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.compute.manager [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Instance network_info: |[{"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-29595ab8-649a-4765-9678-22c2293b1b62 req-fe67914b-9c19-434b-9a4d-fce7d74d7577 service nova] Acquired lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.network.neutron [req-29595ab8-649a-4765-9678-22c2293b1b62 req-fe67914b-9c19-434b-9a4d-fce7d74d7577 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Refreshing network info cache for port 778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Start _get_guest_xml network_info=[{"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:52:09 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:52:09 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-886886887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-886886887',id=27,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb4gesZwfxCDTM0W9aM+C7He0/Aub6UyHKYOgf/t95RKC8+hn/x/f9jOtmOwHySm1O9Cjsn9zMaKpYpEKkII5kNwunF1+RbMLEgByZl4DzqWanUzIfy5QW0JU1Qa09bcg==',key_name='tempest-keypair-631728363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd44d92dded643eb89d955dbf6b4d1e3',ramdisk_id='',reservation_id='r-nh5nv47v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2085503517',owner_user_name='tempest-AttachVolumeShelveTestJSON-2085503517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be8e872f1de4248a557155ff1c4f5ec',uuid=f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converting VIF {"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.objects.instance [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'pci_devices' on Instance uuid f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:52:09 user nova-compute[72990]:   <uuid>f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d</uuid>
Aug 27 03:52:09 user nova-compute[72990]:   <name>instance-0000001b</name>
Aug 27 03:52:09 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:52:09 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:52:09 user nova-compute[72990]:   <metadata>
Aug 27 03:52:09 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:52:09 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:52:09 user nova-compute[72990]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-886886887</nova:name>
Aug 27 03:52:09 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:52:09</nova:creationTime>
Aug 27 03:52:09 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:52:09 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:52:09 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:52:09 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:52:09 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:52:09 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:52:09 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:52:09 user nova-compute[72990]:       <nova:owner>
Aug 27 03:52:09 user nova-compute[72990]:         <nova:user uuid="0be8e872f1de4248a557155ff1c4f5ec">tempest-AttachVolumeShelveTestJSON-2085503517-project-member</nova:user>
Aug 27 03:52:09 user nova-compute[72990]:         <nova:project uuid="bd44d92dded643eb89d955dbf6b4d1e3">tempest-AttachVolumeShelveTestJSON-2085503517</nova:project>
Aug 27 03:52:09 user nova-compute[72990]:       </nova:owner>
Aug 27 03:52:09 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:52:09 user nova-compute[72990]:       <nova:ports>
Aug 27 03:52:09 user nova-compute[72990]:         <nova:port uuid="778be9fb-ea44-464a-b5a7-aea387c1aded">
Aug 27 03:52:09 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 03:52:09 user nova-compute[72990]:         </nova:port>
Aug 27 03:52:09 user nova-compute[72990]:       </nova:ports>
Aug 27 03:52:09 user nova-compute[72990]:     </nova:instance>
Aug 27 03:52:09 user nova-compute[72990]:   </metadata>
Aug 27 03:52:09 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:52:09 user nova-compute[72990]:     <system>
Aug 27 03:52:09 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:52:09 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:52:09 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:52:09 user nova-compute[72990]:       <entry name="serial">f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d</entry>
Aug 27 03:52:09 user nova-compute[72990]:       <entry name="uuid">f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d</entry>
Aug 27 03:52:09 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:52:09 user nova-compute[72990]:     </system>
Aug 27 03:52:09 user nova-compute[72990]:   </sysinfo>
Aug 27 03:52:09 user nova-compute[72990]:   <os>
Aug 27 03:52:09 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:52:09 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:52:09 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:52:09 user nova-compute[72990]:   </os>
Aug 27 03:52:09 user nova-compute[72990]:   <features>
Aug 27 03:52:09 user nova-compute[72990]:     <acpi/>
Aug 27 03:52:09 user nova-compute[72990]:     <apic/>
Aug 27 03:52:09 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:52:09 user nova-compute[72990]:   </features>
Aug 27 03:52:09 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:52:09 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:52:09 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:52:09 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:52:09 user nova-compute[72990]:   </clock>
Aug 27 03:52:09 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:52:09 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:52:09 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:52:09 user nova-compute[72990]:   </cpu>
Aug 27 03:52:09 user nova-compute[72990]:   <devices>
Aug 27 03:52:09 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:52:09 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:52:09 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk"/>
Aug 27 03:52:09 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:52:09 user nova-compute[72990]:     </disk>
Aug 27 03:52:09 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:52:09 user nova-compute[72990]:       <mac address="fa:16:3e:1f:dd:13"/>
Aug 27 03:52:09 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:52:09 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:52:09 user nova-compute[72990]:       <target dev="tap778be9fb-ea"/>
Aug 27 03:52:09 user nova-compute[72990]:     </interface>
Aug 27 03:52:09 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:52:09 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/console.log" append="off"/>
Aug 27 03:52:09 user nova-compute[72990]:     </serial>
Aug 27 03:52:09 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:52:09 user nova-compute[72990]:     <video>
Aug 27 03:52:09 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:52:09 user nova-compute[72990]:     </video>
Aug 27 03:52:09 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:52:09 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:52:09 user nova-compute[72990]:     </rng>
Aug 27 03:52:09 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:52:09 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:52:09 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:52:09 user nova-compute[72990]:     </memballoon>
Aug 27 03:52:09 user nova-compute[72990]:   </devices>
Aug 27 03:52:09 user nova-compute[72990]: </domain>
Aug 27 03:52:09 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-886886887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-886886887',id=27,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb4gesZwfxCDTM0W9aM+C7He0/Aub6UyHKYOgf/t95RKC8+hn/x/f9jOtmOwHySm1O9Cjsn9zMaKpYpEKkII5kNwunF1+RbMLEgByZl4DzqWanUzIfy5QW0JU1Qa09bcg==',key_name='tempest-keypair-631728363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd44d92dded643eb89d955dbf6b4d1e3',ramdisk_id='',reservation_id='r-nh5nv47v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2085503517',owner_user_name='tempest-AttachVolumeShelveTestJSON-2085503517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be8e872f1de4248a557155ff1c4f5ec',uuid=f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converting VIF {"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG os_vif [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap778be9fb-ea, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap778be9fb-ea, col_values=(('external_ids', {'iface-id': '778be9fb-ea44-464a-b5a7-aea387c1aded', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:dd:13', 'vm-uuid': 'f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:52:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:09 user nova-compute[72990]: INFO os_vif [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea')
Aug 27 03:52:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:52:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] No VIF found with MAC fa:16:3e:1f:dd:13, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:52:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:10 user nova-compute[72990]: DEBUG nova.network.neutron [req-29595ab8-649a-4765-9678-22c2293b1b62 req-fe67914b-9c19-434b-9a4d-fce7d74d7577 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updated VIF entry in instance network info cache for port 778be9fb-ea44-464a-b5a7-aea387c1aded. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:52:10 user nova-compute[72990]: DEBUG nova.network.neutron [req-29595ab8-649a-4765-9678-22c2293b1b62 req-fe67914b-9c19-434b-9a4d-fce7d74d7577 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updating instance_info_cache with network_info: [{"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:52:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-29595ab8-649a-4765-9678-22c2293b1b62 req-fe67914b-9c19-434b-9a4d-fce7d74d7577 service nova] Releasing lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108316.0099332, f2c7f4ed-0c08-4bd8-8386-3830b33a2564 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:11 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] VM Stopped (Lifecycle Event)
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5f175a13-a993-4fbb-95ac-7ebb49ad1752 None None] [instance: f2c7f4ed-0c08-4bd8-8386-3830b33a2564] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-092e5630-5bd7-4062-86e4-59119da1213d req-0f3ae19d-a31c-4193-8b7f-59c1cf833bb1 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-092e5630-5bd7-4062-86e4-59119da1213d req-0f3ae19d-a31c-4193-8b7f-59c1cf833bb1 service nova] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-092e5630-5bd7-4062-86e4-59119da1213d req-0f3ae19d-a31c-4193-8b7f-59c1cf833bb1 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-092e5630-5bd7-4062-86e4-59119da1213d req-0f3ae19d-a31c-4193-8b7f-59c1cf833bb1 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-092e5630-5bd7-4062-86e4-59119da1213d req-0f3ae19d-a31c-4193-8b7f-59c1cf833bb1 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] No waiting events found dispatching network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:52:11 user nova-compute[72990]: WARNING nova.compute.manager [req-092e5630-5bd7-4062-86e4-59119da1213d req-0f3ae19d-a31c-4193-8b7f-59c1cf833bb1 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received unexpected event network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded for instance with vm_state building and task_state spawning.
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-1943009a-d292-4939-920b-3ab20fca2744 req-0f06b1fa-0835-42e3-915a-037c3b0eed12 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1943009a-d292-4939-920b-3ab20fca2744 req-0f06b1fa-0835-42e3-915a-037c3b0eed12 service nova] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1943009a-d292-4939-920b-3ab20fca2744 req-0f06b1fa-0835-42e3-915a-037c3b0eed12 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1943009a-d292-4939-920b-3ab20fca2744 req-0f06b1fa-0835-42e3-915a-037c3b0eed12 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-1943009a-d292-4939-920b-3ab20fca2744 req-0f06b1fa-0835-42e3-915a-037c3b0eed12 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] No waiting events found dispatching network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:52:11 user nova-compute[72990]: WARNING nova.compute.manager [req-1943009a-d292-4939-920b-3ab20fca2744 req-0f06b1fa-0835-42e3-915a-037c3b0eed12 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received unexpected event network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac for instance with vm_state building and task_state spawning.
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108331.8130941, aa475371-4888-4c4b-9b74-4e813b804da6 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] VM Resumed (Lifecycle Event)
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:52:11 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Instance spawned successfully.
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108331.819639, aa475371-4888-4c4b-9b74-4e813b804da6 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] VM Started (Lifecycle Event)
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:52:11 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:52:11 user nova-compute[72990]: INFO nova.compute.manager [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Took 5.96 seconds to spawn the instance on the hypervisor.
Aug 27 03:52:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:12 user nova-compute[72990]: INFO nova.compute.manager [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Took 21.30 seconds to build instance.
Aug 27 03:52:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-52d0d67a-5f24-4d16-b177-ba7129dd8172 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "aa475371-4888-4c4b-9b74-4e813b804da6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.409s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG os_brick.utils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc57a4bf-f187-4f77-95f7-0407ac694cd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e048456d-b840-4686-9842-cb855162c7b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5ec124-fc67-4191-88a5-871434331550]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f1ef4c-308b-477b-9f97-8d11ebc62a36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:52:13 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[525f2ad7-2c97-492b-bb33-4cde93f88a11]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG os_brick.utils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] <== get_connector_properties: return (279ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Updating existing volume attachment record: 7184ee7e-7b6f-48fc-af9a-b487f6caf55f {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-ab442b0b-a329-4c40-a699-7f60ab503fd1 req-6a02d627-56ca-4bea-ae5a-ab839fde3db9 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ab442b0b-a329-4c40-a699-7f60ab503fd1 req-6a02d627-56ca-4bea-ae5a-ab839fde3db9 service nova] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ab442b0b-a329-4c40-a699-7f60ab503fd1 req-6a02d627-56ca-4bea-ae5a-ab839fde3db9 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ab442b0b-a329-4c40-a699-7f60ab503fd1 req-6a02d627-56ca-4bea-ae5a-ab839fde3db9 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-ab442b0b-a329-4c40-a699-7f60ab503fd1 req-6a02d627-56ca-4bea-ae5a-ab839fde3db9 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] No waiting events found dispatching network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:52:13 user nova-compute[72990]: WARNING nova.compute.manager [req-ab442b0b-a329-4c40-a699-7f60ab503fd1 req-6a02d627-56ca-4bea-ae5a-ab839fde3db9 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received unexpected event network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded for instance with vm_state building and task_state spawning.
Aug 27 03:52:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108333.9434068, f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] VM Resumed (Lifecycle Event)
Aug 27 03:52:13 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Instance spawned successfully.
Aug 27 03:52:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:52:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:14 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:52:14 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108333.9471977, f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:14 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] VM Started (Lifecycle Event)
Aug 27 03:52:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:52:14 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:52:14 user nova-compute[72990]: INFO nova.compute.manager [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Took 7.09 seconds to spawn the instance on the hypervisor.
Aug 27 03:52:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:14 user nova-compute[72990]: INFO nova.compute.manager [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Took 8.35 seconds to build instance.
Aug 27 03:52:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-239355a2-672c-42fd-b8f2-c2b9aafeae7a tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.515s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:25 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:52:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:52:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:52:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:52:28 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Creating image(s)
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Ensure instance console log exists: /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Start _get_guest_xml network_info=[{"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '7184ee7e-7b6f-48fc-af9a-b487f6caf55f', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMWzfXqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '250288e9-5421-4757-9258-fa1cf0c3be2f', 'attached_at': '', 'detached_at': '', 'volume_id': '9abacf48-09ce-40ba-8934-9b6d50bfe212', 'serial': '9abacf48-09ce-40ba-8934-9b6d50bfe212'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:52:28 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:52:28 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMWzfXqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:52:28 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:52:28 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:52:28 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b60cfad-ab17-436c-b0e0-8421d3c9cedb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:52:28 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3b98de-dc3e-45b8-9685-a85923e412f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212] added
Aug 27 03:52:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a43c2f-af79-46b2-800d-abffe932e46b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea52ca8-802b-4f3e-9fce-25708a0d5ee8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMWzfXqR {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMWzfXqR" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33c9821-610c-4dc5-8b42-aabde1a6e0a0]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMWzfXqR'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf70254-ead9-4a4c-a2dc-17b202e84214]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "d4f94cba-21ec-42a8-babc-859becde2c82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c1686c-a46b-42bc-b1d1-21418bfd8aab]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.compute.manager [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6e4ab0-128e-4faa-b3b9-e60a6ae94a25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212, portal: 172.16.0.220,3260]
Aug 27 03:52:28 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212, portal: 172.16.0.220,3260] successful.
Aug 27 03:52:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.043s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f8deb9-c150-401b-a5a6-e375fe95ead2]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:52:28 user nova-compute[72990]: INFO nova.compute.claims [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Claim successful on node user
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcca25f-c515-471c-bc96-5daead999a0a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:52:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] HCTL ('39', '-', '-', 0) found on session 30 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0719966b-a8ec-4e0b-aec1-22a8c5d99ea5]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:52:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMWzfXqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.network.neutron [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:52:29 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:52:29 user nova-compute[72990]: INFO nova.virt.block_device [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Booting with volume a9e1e7bb-c0c9-4659-8796-97fded91b363 at /dev/vda
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.policy [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb95e31732904174a8ebddf48c6426ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2282ed15ca724f029c368c8a5ce0f268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG os_brick.utils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5556ef32-8ed9-416a-bf1c-37ea286a2dfe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fff699-9243-4372-9c25-1d64d53e8a10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ad22b6-6553-4285-979e-948aff3bc32c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab28d127-5890-4068-9202-acbd35a19ef2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:52:29 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7a365e-1c50-4abe-abd9-f5aa86a9a200]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG os_brick.utils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updating existing volume attachment record: b3087066-7da3-470f-9dd6-7e03bfef48e2 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '23030663866626665', 'path': '/dev/sdh'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030663866626665', 'path': '/dev/sdh'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-46726741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-46726741',id=26,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-mfhlhcbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:51:57Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=250288e9-5421-4757-9258-fa1cf0c3be2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=f92099d9-a8e3-45fa-879a-40a71a5ca301,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92099d9-a8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.objects.instance [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'pci_devices' on Instance uuid 250288e9-5421-4757-9258-fa1cf0c3be2f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:52:29 user nova-compute[72990]:   <uuid>250288e9-5421-4757-9258-fa1cf0c3be2f</uuid>
Aug 27 03:52:29 user nova-compute[72990]:   <name>instance-0000001a</name>
Aug 27 03:52:29 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:52:29 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:52:29 user nova-compute[72990]:   <metadata>
Aug 27 03:52:29 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:52:29 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:52:29 user nova-compute[72990]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-46726741</nova:name>
Aug 27 03:52:29 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:52:28</nova:creationTime>
Aug 27 03:52:29 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:52:29 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:52:29 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:52:29 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:52:29 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:52:29 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:52:29 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:52:29 user nova-compute[72990]:       <nova:owner>
Aug 27 03:52:29 user nova-compute[72990]:         <nova:user uuid="858a63e8d5964f38ad776985cfbe9121">tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member</nova:user>
Aug 27 03:52:29 user nova-compute[72990]:         <nova:project uuid="183297ba5b6549fdb39f2135d92b3794">tempest-ServerBootFromVolumeStableRescueTest-1839224225</nova:project>
Aug 27 03:52:29 user nova-compute[72990]:       </nova:owner>
Aug 27 03:52:29 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:52:29 user nova-compute[72990]:       <nova:ports>
Aug 27 03:52:29 user nova-compute[72990]:         <nova:port uuid="f92099d9-a8e3-45fa-879a-40a71a5ca301">
Aug 27 03:52:29 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 03:52:29 user nova-compute[72990]:         </nova:port>
Aug 27 03:52:29 user nova-compute[72990]:       </nova:ports>
Aug 27 03:52:29 user nova-compute[72990]:     </nova:instance>
Aug 27 03:52:29 user nova-compute[72990]:   </metadata>
Aug 27 03:52:29 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:52:29 user nova-compute[72990]:     <system>
Aug 27 03:52:29 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:52:29 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:52:29 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:52:29 user nova-compute[72990]:       <entry name="serial">250288e9-5421-4757-9258-fa1cf0c3be2f</entry>
Aug 27 03:52:29 user nova-compute[72990]:       <entry name="uuid">250288e9-5421-4757-9258-fa1cf0c3be2f</entry>
Aug 27 03:52:29 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:52:29 user nova-compute[72990]:     </system>
Aug 27 03:52:29 user nova-compute[72990]:   </sysinfo>
Aug 27 03:52:29 user nova-compute[72990]:   <os>
Aug 27 03:52:29 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:52:29 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:52:29 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:52:29 user nova-compute[72990]:   </os>
Aug 27 03:52:29 user nova-compute[72990]:   <features>
Aug 27 03:52:29 user nova-compute[72990]:     <acpi/>
Aug 27 03:52:29 user nova-compute[72990]:     <apic/>
Aug 27 03:52:29 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:52:29 user nova-compute[72990]:   </features>
Aug 27 03:52:29 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:52:29 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:52:29 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:52:29 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:52:29 user nova-compute[72990]:   </clock>
Aug 27 03:52:29 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:52:29 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:52:29 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:52:29 user nova-compute[72990]:   </cpu>
Aug 27 03:52:29 user nova-compute[72990]:   <devices>
Aug 27 03:52:29 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:52:29 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:52:29 user nova-compute[72990]:       <source dev="/dev/sdh"/>
Aug 27 03:52:29 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:52:29 user nova-compute[72990]:       <serial>9abacf48-09ce-40ba-8934-9b6d50bfe212</serial>
Aug 27 03:52:29 user nova-compute[72990]:     </disk>
Aug 27 03:52:29 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:52:29 user nova-compute[72990]:       <mac address="fa:16:3e:81:0c:0f"/>
Aug 27 03:52:29 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:52:29 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:52:29 user nova-compute[72990]:       <target dev="tapf92099d9-a8"/>
Aug 27 03:52:29 user nova-compute[72990]:     </interface>
Aug 27 03:52:29 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:52:29 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/console.log" append="off"/>
Aug 27 03:52:29 user nova-compute[72990]:     </serial>
Aug 27 03:52:29 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:52:29 user nova-compute[72990]:     <video>
Aug 27 03:52:29 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:52:29 user nova-compute[72990]:     </video>
Aug 27 03:52:29 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:52:29 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:52:29 user nova-compute[72990]:     </rng>
Aug 27 03:52:29 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:52:29 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:52:29 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:52:29 user nova-compute[72990]:     </memballoon>
Aug 27 03:52:29 user nova-compute[72990]:   </devices>
Aug 27 03:52:29 user nova-compute[72990]: </domain>
Aug 27 03:52:29 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-46726741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-46726741',id=26,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-mfhlhcbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:51:57Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=250288e9-5421-4757-9258-fa1cf0c3be2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=f92099d9-a8e3-45fa-879a-40a71a5ca301,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92099d9-a8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG os_vif [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=f92099d9-a8e3-45fa-879a-40a71a5ca301,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92099d9-a8') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf92099d9-a8, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf92099d9-a8, col_values=(('external_ids', {'iface-id': 'f92099d9-a8e3-45fa-879a-40a71a5ca301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:0c:0f', 'vm-uuid': '250288e9-5421-4757-9258-fa1cf0c3be2f'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:29 user nova-compute[72990]: INFO os_vif [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=f92099d9-a8e3-45fa-879a-40a71a5ca301,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92099d9-a8')
Aug 27 03:52:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:52:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No VIF found with MAC fa:16:3e:81:0c:0f, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG nova.network.neutron [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Successfully created port: a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG nova.network.neutron [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Successfully updated port: a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquired lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG nova.network.neutron [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-5e3f2761-16e7-45b6-8e3c-fc027636e9fa req-36a3b213-bc9f-4a81-8bfd-43142ee99308 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received event network-changed-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-5e3f2761-16e7-45b6-8e3c-fc027636e9fa req-36a3b213-bc9f-4a81-8bfd-43142ee99308 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Refreshing instance network info cache due to event network-changed-a9b2e415-e44f-4302-9a4a-6b079b3b4c29. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5e3f2761-16e7-45b6-8e3c-fc027636e9fa req-36a3b213-bc9f-4a81-8bfd-43142ee99308 service nova] Acquiring lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG nova.network.neutron [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-9ebcd243-752c-46d5-bcc3-730b9ffe90d9 req-91998419-ca66-4041-b514-f47921431f1d service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9ebcd243-752c-46d5-bcc3-730b9ffe90d9 req-91998419-ca66-4041-b514-f47921431f1d service nova] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9ebcd243-752c-46d5-bcc3-730b9ffe90d9 req-91998419-ca66-4041-b514-f47921431f1d service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9ebcd243-752c-46d5-bcc3-730b9ffe90d9 req-91998419-ca66-4041-b514-f47921431f1d service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-9ebcd243-752c-46d5-bcc3-730b9ffe90d9 req-91998419-ca66-4041-b514-f47921431f1d service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] No waiting events found dispatching network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:52:31 user nova-compute[72990]: WARNING nova.compute.manager [req-9ebcd243-752c-46d5-bcc3-730b9ffe90d9 req-91998419-ca66-4041-b514-f47921431f1d service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received unexpected event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 for instance with vm_state building and task_state spawning.
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updating instance_info_cache with network_info: [{"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Releasing lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Instance network_info: |[{"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5e3f2761-16e7-45b6-8e3c-fc027636e9fa req-36a3b213-bc9f-4a81-8bfd-43142ee99308 service nova] Acquired lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-5e3f2761-16e7-45b6-8e3c-fc027636e9fa req-36a3b213-bc9f-4a81-8bfd-43142ee99308 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Refreshing network info cache for port a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-5e3f2761-16e7-45b6-8e3c-fc027636e9fa req-36a3b213-bc9f-4a81-8bfd-43142ee99308 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updated VIF entry in instance network info cache for port a9b2e415-e44f-4302-9a4a-6b079b3b4c29. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-5e3f2761-16e7-45b6-8e3c-fc027636e9fa req-36a3b213-bc9f-4a81-8bfd-43142ee99308 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updating instance_info_cache with network_info: [{"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5e3f2761-16e7-45b6-8e3c-fc027636e9fa req-36a3b213-bc9f-4a81-8bfd-43142ee99308 service nova] Releasing lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:52:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108353.6422124, 250288e9-5421-4757-9258-fa1cf0c3be2f => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:33 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] VM Resumed (Lifecycle Event)
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-02761638-745e-4b15-83a7-9d5db3498d9f req-9066e20a-0996-4791-915f-b872dd2be464 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-02761638-745e-4b15-83a7-9d5db3498d9f req-9066e20a-0996-4791-915f-b872dd2be464 service nova] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-02761638-745e-4b15-83a7-9d5db3498d9f req-9066e20a-0996-4791-915f-b872dd2be464 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-02761638-745e-4b15-83a7-9d5db3498d9f req-9066e20a-0996-4791-915f-b872dd2be464 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-02761638-745e-4b15-83a7-9d5db3498d9f req-9066e20a-0996-4791-915f-b872dd2be464 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] No waiting events found dispatching network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:52:33 user nova-compute[72990]: WARNING nova.compute.manager [req-02761638-745e-4b15-83a7-9d5db3498d9f req-9066e20a-0996-4791-915f-b872dd2be464 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received unexpected event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 for instance with vm_state building and task_state spawning.
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:33 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Instance spawned successfully.
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:33 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108353.64385, 250288e9-5421-4757-9258-fa1cf0c3be2f => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:33 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] VM Started (Lifecycle Event)
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:52:33 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:33 user nova-compute[72990]: INFO nova.compute.manager [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Took 5.60 seconds to spawn the instance on the hypervisor.
Aug 27 03:52:33 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:33 user nova-compute[72990]: INFO nova.compute.manager [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Took 37.28 seconds to build instance.
Aug 27 03:52:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5cf3b972-6a31-4a12-bcda-c2571da28edb tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.403s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:35 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:52:35 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=6916MB free_disk=25.065731048583984GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 6a44010b-9a96-4343-a35c-1f212d21e47b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 15a88698-88d1-4c6b-9e40-98b618978a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance c540f8c5-8827-4991-bee7-e2fce0c2d978 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 338682cb-8c70-49c3-b88c-362e96ec8fb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance a0800495-d65a-4cdc-95d7-b0e0d07e3e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aa475371-4888-4c4b-9b74-4e813b804da6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 250288e9-5421-4757-9258-fa1cf0c3be2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance d4f94cba-21ec-42a8-babc-859becde2c82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:52:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.747s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:37 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:52:37 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:52:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:52:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:52:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:52:37 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:52:38 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updating instance_info_cache with network_info: [{"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:52:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:52:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:52:38 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:52:38 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:52:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:52:43 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Creating image(s)
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Ensure instance console log exists: /opt/stack/data/nova/instances/d4f94cba-21ec-42a8-babc-859becde2c82/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Start _get_guest_xml network_info=[{"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'b3087066-7da3-470f-9dd6-7e03bfef48e2', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcdBbxJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd4f94cba-21ec-42a8-babc-859becde2c82', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9e1e7bb-c0c9-4659-8796-97fded91b363', 'serial': 'a9e1e7bb-c0c9-4659-8796-97fded91b363'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:52:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:52:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcdBbxJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:52:43 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:52:43 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:52:43 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e82f9f7-bd71-41e7-81c8-115ad0ccb7c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:52:43 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf285348-4f8a-4e65-956e-5c52ed2c1931]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363] added
Aug 27 03:52:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[317b7eb4-4303-4085-9ff6-1a00f32e8d8d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8662890-f0e2-4846-9550-86124270b864]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YcdBbxJv {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YcdBbxJv" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b6feb8-f1ee-48df-b874-1165349eab29]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YcdBbxJv'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[931b110f-23a7-4330-ac5a-bd06d30c9bd5]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62b81f8-be83-4aad-a2c8-4cc7bfac2137]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6006fcf-b3fd-4080-987e-a3d805488669]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260]
Aug 27 03:52:43 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260] successful.
Aug 27 03:52:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5d196a-fbb4-4bec-b3d9-fe02e6ff14af]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a1aa74-a71e-402d-8e80-733d73bd2c00]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:52:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] HCTL ('40', '-', '-', 0) found on session 31 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fab37f1-d8b0-491e-a294-dd1923b89949]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching for a device in session 31 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:52:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcdBbxJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26564613130383730', 'path': '/dev/sdi'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564613130383730', 'path': '/dev/sdi'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1658965801',display_name='tempest-ServerActionsTestOtherA-server-1658965801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1658965801',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx4YMOpiFApd+UuDRSLGi+Pmb0zohcJr1O+wFKm9ZeByZUcToOSr5LVAydvhFQAlBpKXomrxo0iOLbfaHvfjryxwDtlu2Xqz9AegDptkwou3u7ClkNhexzzpMlOVgjY6Q==',key_name='tempest-keypair-749840506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-k1hscn8l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:52:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=d4f94cba-21ec-42a8-babc-859becde2c82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG nova.objects.instance [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lazy-loading 'pci_devices' on Instance uuid d4f94cba-21ec-42a8-babc-859becde2c82 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:52:44 user nova-compute[72990]:   <uuid>d4f94cba-21ec-42a8-babc-859becde2c82</uuid>
Aug 27 03:52:44 user nova-compute[72990]:   <name>instance-0000001c</name>
Aug 27 03:52:44 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:52:44 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:52:44 user nova-compute[72990]:   <metadata>
Aug 27 03:52:44 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:52:44 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:52:44 user nova-compute[72990]:       <nova:name>tempest-ServerActionsTestOtherA-server-1658965801</nova:name>
Aug 27 03:52:44 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:52:43</nova:creationTime>
Aug 27 03:52:44 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:52:44 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:52:44 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:52:44 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:52:44 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:52:44 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:52:44 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:52:44 user nova-compute[72990]:       <nova:owner>
Aug 27 03:52:44 user nova-compute[72990]:         <nova:user uuid="cb95e31732904174a8ebddf48c6426ed">tempest-ServerActionsTestOtherA-938526966-project-member</nova:user>
Aug 27 03:52:44 user nova-compute[72990]:         <nova:project uuid="2282ed15ca724f029c368c8a5ce0f268">tempest-ServerActionsTestOtherA-938526966</nova:project>
Aug 27 03:52:44 user nova-compute[72990]:       </nova:owner>
Aug 27 03:52:44 user nova-compute[72990]:       <nova:ports>
Aug 27 03:52:44 user nova-compute[72990]:         <nova:port uuid="a9b2e415-e44f-4302-9a4a-6b079b3b4c29">
Aug 27 03:52:44 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 03:52:44 user nova-compute[72990]:         </nova:port>
Aug 27 03:52:44 user nova-compute[72990]:       </nova:ports>
Aug 27 03:52:44 user nova-compute[72990]:     </nova:instance>
Aug 27 03:52:44 user nova-compute[72990]:   </metadata>
Aug 27 03:52:44 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:52:44 user nova-compute[72990]:     <system>
Aug 27 03:52:44 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:52:44 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:52:44 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:52:44 user nova-compute[72990]:       <entry name="serial">d4f94cba-21ec-42a8-babc-859becde2c82</entry>
Aug 27 03:52:44 user nova-compute[72990]:       <entry name="uuid">d4f94cba-21ec-42a8-babc-859becde2c82</entry>
Aug 27 03:52:44 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:52:44 user nova-compute[72990]:     </system>
Aug 27 03:52:44 user nova-compute[72990]:   </sysinfo>
Aug 27 03:52:44 user nova-compute[72990]:   <os>
Aug 27 03:52:44 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:52:44 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:52:44 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:52:44 user nova-compute[72990]:   </os>
Aug 27 03:52:44 user nova-compute[72990]:   <features>
Aug 27 03:52:44 user nova-compute[72990]:     <acpi/>
Aug 27 03:52:44 user nova-compute[72990]:     <apic/>
Aug 27 03:52:44 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:52:44 user nova-compute[72990]:   </features>
Aug 27 03:52:44 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:52:44 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:52:44 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:52:44 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:52:44 user nova-compute[72990]:   </clock>
Aug 27 03:52:44 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:52:44 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:52:44 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:52:44 user nova-compute[72990]:   </cpu>
Aug 27 03:52:44 user nova-compute[72990]:   <devices>
Aug 27 03:52:44 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:52:44 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:52:44 user nova-compute[72990]:       <source dev="/dev/sdi"/>
Aug 27 03:52:44 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:52:44 user nova-compute[72990]:       <serial>a9e1e7bb-c0c9-4659-8796-97fded91b363</serial>
Aug 27 03:52:44 user nova-compute[72990]:     </disk>
Aug 27 03:52:44 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:52:44 user nova-compute[72990]:       <mac address="fa:16:3e:fb:cc:38"/>
Aug 27 03:52:44 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:52:44 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:52:44 user nova-compute[72990]:       <target dev="tapa9b2e415-e4"/>
Aug 27 03:52:44 user nova-compute[72990]:     </interface>
Aug 27 03:52:44 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:52:44 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/d4f94cba-21ec-42a8-babc-859becde2c82/console.log" append="off"/>
Aug 27 03:52:44 user nova-compute[72990]:     </serial>
Aug 27 03:52:44 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:52:44 user nova-compute[72990]:     <video>
Aug 27 03:52:44 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:52:44 user nova-compute[72990]:     </video>
Aug 27 03:52:44 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:52:44 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:52:44 user nova-compute[72990]:     </rng>
Aug 27 03:52:44 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:52:44 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:52:44 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:52:44 user nova-compute[72990]:     </memballoon>
Aug 27 03:52:44 user nova-compute[72990]:   </devices>
Aug 27 03:52:44 user nova-compute[72990]: </domain>
Aug 27 03:52:44 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1658965801',display_name='tempest-ServerActionsTestOtherA-server-1658965801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1658965801',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx4YMOpiFApd+UuDRSLGi+Pmb0zohcJr1O+wFKm9ZeByZUcToOSr5LVAydvhFQAlBpKXomrxo0iOLbfaHvfjryxwDtlu2Xqz9AegDptkwou3u7ClkNhexzzpMlOVgjY6Q==',key_name='tempest-keypair-749840506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-k1hscn8l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:52:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=d4f94cba-21ec-42a8-babc-859becde2c82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG os_vif [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9b2e415-e4, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9b2e415-e4, col_values=(('external_ids', {'iface-id': 'a9b2e415-e44f-4302-9a4a-6b079b3b4c29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:cc:38', 'vm-uuid': 'd4f94cba-21ec-42a8-babc-859becde2c82'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:44 user nova-compute[72990]: INFO os_vif [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4')
Aug 27 03:52:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:52:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No VIF found with MAC fa:16:3e:fb:cc:38, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:52:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-36c75933-8899-42f7-9511-81c0b2f28723 req-7036f7a6-cfb9-43ee-8bb3-5f94da729733 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received event network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-36c75933-8899-42f7-9511-81c0b2f28723 req-7036f7a6-cfb9-43ee-8bb3-5f94da729733 service nova] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-36c75933-8899-42f7-9511-81c0b2f28723 req-7036f7a6-cfb9-43ee-8bb3-5f94da729733 service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-36c75933-8899-42f7-9511-81c0b2f28723 req-7036f7a6-cfb9-43ee-8bb3-5f94da729733 service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-36c75933-8899-42f7-9511-81c0b2f28723 req-7036f7a6-cfb9-43ee-8bb3-5f94da729733 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] No waiting events found dispatching network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:52:46 user nova-compute[72990]: WARNING nova.compute.manager [req-36c75933-8899-42f7-9511-81c0b2f28723 req-7036f7a6-cfb9-43ee-8bb3-5f94da729733 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received unexpected event network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 for instance with vm_state building and task_state spawning.
Aug 27 03:52:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108368.0296085, d4f94cba-21ec-42a8-babc-859becde2c82 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:48 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] VM Resumed (Lifecycle Event)
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:52:48 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Instance spawned successfully.
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:52:48 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108368.031925, d4f94cba-21ec-42a8-babc-859becde2c82 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:52:48 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] VM Started (Lifecycle Event)
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:52:48 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:52:48 user nova-compute[72990]: INFO nova.compute.manager [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Took 5.02 seconds to spawn the instance on the hypervisor.
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:52:48 user nova-compute[72990]: INFO nova.compute.manager [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Took 19.59 seconds to build instance.
Aug 27 03:52:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-411dbff2-a164-4cec-829d-8a1b4668c91e tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "d4f94cba-21ec-42a8-babc-859becde2c82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.724s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-175177ec-7fa3-4e72-baae-57ce2dda1d54 req-fe0bd1c0-e3f2-497b-8448-e450e66b1a5e service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received event network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-175177ec-7fa3-4e72-baae-57ce2dda1d54 req-fe0bd1c0-e3f2-497b-8448-e450e66b1a5e service nova] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-175177ec-7fa3-4e72-baae-57ce2dda1d54 req-fe0bd1c0-e3f2-497b-8448-e450e66b1a5e service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-175177ec-7fa3-4e72-baae-57ce2dda1d54 req-fe0bd1c0-e3f2-497b-8448-e450e66b1a5e service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:52:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-175177ec-7fa3-4e72-baae-57ce2dda1d54 req-fe0bd1c0-e3f2-497b-8448-e450e66b1a5e service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] No waiting events found dispatching network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:52:48 user nova-compute[72990]: WARNING nova.compute.manager [req-175177ec-7fa3-4e72-baae-57ce2dda1d54 req-fe0bd1c0-e3f2-497b-8448-e450e66b1a5e service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received unexpected event network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 for instance with vm_state active and task_state None.
Aug 27 03:52:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:52:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:01 user nova-compute[72990]: INFO nova.compute.manager [None req-c95b2534-914c-4fbb-8c08-370b1de5e1b6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Unrescuing
Aug 27 03:53:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c95b2534-914c-4fbb-8c08-370b1de5e1b6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:53:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c95b2534-914c-4fbb-8c08-370b1de5e1b6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquired lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:53:01 user nova-compute[72990]: DEBUG nova.network.neutron [None req-c95b2534-914c-4fbb-8c08-370b1de5e1b6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG nova.network.neutron [None req-c95b2534-914c-4fbb-8c08-370b1de5e1b6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updating instance_info_cache with network_info: [{"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c95b2534-914c-4fbb-8c08-370b1de5e1b6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Releasing lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c95b2534-914c-4fbb-8c08-370b1de5e1b6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'flavor' on Instance uuid 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-d2eb88c9-bbee-4c89-b54f-379ff561755a req-4c65b813-bfc6-4fec-ba12-106fe5b548b6 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-unplugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d2eb88c9-bbee-4c89-b54f-379ff561755a req-4c65b813-bfc6-4fec-ba12-106fe5b548b6 service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d2eb88c9-bbee-4c89-b54f-379ff561755a req-4c65b813-bfc6-4fec-ba12-106fe5b548b6 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d2eb88c9-bbee-4c89-b54f-379ff561755a req-4c65b813-bfc6-4fec-ba12-106fe5b548b6 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-d2eb88c9-bbee-4c89-b54f-379ff561755a req-4c65b813-bfc6-4fec-ba12-106fe5b548b6 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-unplugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:53:02 user nova-compute[72990]: WARNING nova.compute.manager [req-d2eb88c9-bbee-4c89-b54f-379ff561755a req-4c65b813-bfc6-4fec-ba12-106fe5b548b6 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-unplugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:53:03 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Instance destroyed successfully.
Aug 27 03:53:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-21989d87-0fdc-43b3-be02-1ae8ac6e48be req-d44efb3f-213d-4719-92cd-a9501904bc89 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-21989d87-0fdc-43b3-be02-1ae8ac6e48be req-d44efb3f-213d-4719-92cd-a9501904bc89 service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-21989d87-0fdc-43b3-be02-1ae8ac6e48be req-d44efb3f-213d-4719-92cd-a9501904bc89 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-21989d87-0fdc-43b3-be02-1ae8ac6e48be req-d44efb3f-213d-4719-92cd-a9501904bc89 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-21989d87-0fdc-43b3-be02-1ae8ac6e48be req-d44efb3f-213d-4719-92cd-a9501904bc89 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:53:05 user nova-compute[72990]: WARNING nova.compute.manager [req-21989d87-0fdc-43b3-be02-1ae8ac6e48be req-d44efb3f-213d-4719-92cd-a9501904bc89 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:53:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-8b814535-8b13-4965-a0fa-31c5a1133c2b req-1735c064-b183-42be-a038-3d441e3d5d89 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8b814535-8b13-4965-a0fa-31c5a1133c2b req-1735c064-b183-42be-a038-3d441e3d5d89 service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8b814535-8b13-4965-a0fa-31c5a1133c2b req-1735c064-b183-42be-a038-3d441e3d5d89 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8b814535-8b13-4965-a0fa-31c5a1133c2b req-1735c064-b183-42be-a038-3d441e3d5d89 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-8b814535-8b13-4965-a0fa-31c5a1133c2b req-1735c064-b183-42be-a038-3d441e3d5d89 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:53:07 user nova-compute[72990]: WARNING nova.compute.manager [req-8b814535-8b13-4965-a0fa-31c5a1133c2b req-1735c064-b183-42be-a038-3d441e3d5d89 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:53:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-8b814535-8b13-4965-a0fa-31c5a1133c2b req-1735c064-b183-42be-a038-3d441e3d5d89 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8b814535-8b13-4965-a0fa-31c5a1133c2b req-1735c064-b183-42be-a038-3d441e3d5d89 service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8b814535-8b13-4965-a0fa-31c5a1133c2b req-1735c064-b183-42be-a038-3d441e3d5d89 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8b814535-8b13-4965-a0fa-31c5a1133c2b req-1735c064-b183-42be-a038-3d441e3d5d89 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-8b814535-8b13-4965-a0fa-31c5a1133c2b req-1735c064-b183-42be-a038-3d441e3d5d89 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:53:07 user nova-compute[72990]: WARNING nova.compute.manager [req-8b814535-8b13-4965-a0fa-31c5a1133c2b req-1735c064-b183-42be-a038-3d441e3d5d89 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:53:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Removed pending event for 15a88698-88d1-4c6b-9e40-98b618978a33 due to event {{(pid=72990) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 03:53:07 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108387.182085, 15a88698-88d1-4c6b-9e40-98b618978a33 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:53:07 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] VM Resumed (Lifecycle Event)
Aug 27 03:53:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c95b2534-914c-4fbb-8c08-370b1de5e1b6 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:53:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:53:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:53:07 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 03:53:07 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108387.1833436, 15a88698-88d1-4c6b-9e40-98b618978a33 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:53:07 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] VM Started (Lifecycle Event)
Aug 27 03:53:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:53:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:53:07 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 03:53:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:08 user nova-compute[72990]: INFO nova.compute.manager [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Terminating instance
Aug 27 03:53:08 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-b9c70dfe-2810-40aa-af56-8eff290f441d req-d4e620b8-b956-4da0-b8a8-2a37a64f8ae2 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event network-vif-unplugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b9c70dfe-2810-40aa-af56-8eff290f441d req-d4e620b8-b956-4da0-b8a8-2a37a64f8ae2 service nova] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b9c70dfe-2810-40aa-af56-8eff290f441d req-d4e620b8-b956-4da0-b8a8-2a37a64f8ae2 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b9c70dfe-2810-40aa-af56-8eff290f441d req-d4e620b8-b956-4da0-b8a8-2a37a64f8ae2 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-b9c70dfe-2810-40aa-af56-8eff290f441d req-d4e620b8-b956-4da0-b8a8-2a37a64f8ae2 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] No waiting events found dispatching network-vif-unplugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-b9c70dfe-2810-40aa-af56-8eff290f441d req-d4e620b8-b956-4da0-b8a8-2a37a64f8ae2 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event network-vif-unplugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:53:08 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Instance destroyed successfully.
Aug 27 03:53:08 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lazy-loading 'resources' on Instance uuid c540f8c5-8827-4991-bee7-e2fce0c2d978 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-908476780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-673714117',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3PAyQeday+k2IVElwpEXGXjfzzJ3SXG/LO6/dnOTC3QPukrFT+NJp9oRqOaHwRI++w7DioJsEXHO6yZTpNitN00RbRTemlQN1FB2LLFWDsMykIWyCtKESzmuLVzHdmnQ==',key_name='tempest-keypair-1971563117',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:52:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='062c6a1b8e4e405cb53c04da895064a6',ramdisk_id='',reservation_id='r-adnhkrxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-46885198',owner_user_name='tempest-ServerActionsV293TestJSON-46885198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91e477a683a499a93952e484480f4dd',uuid=c540f8c5-8827-4991-bee7-e2fce0c2d978,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Converting VIF {"id": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "address": "fa:16:3e:c7:b6:d4", "network": {"id": "bcfa8713-5d16-4fec-bd15-9084b98de4ad", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1392374717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "062c6a1b8e4e405cb53c04da895064a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8682c013-92", "ovs_interfaceid": "8682c013-92cc-4a9a-bb77-a69abc07cd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG os_vif [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8682c013-92, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:53:08 user nova-compute[72990]: INFO os_vif [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:d4,bridge_name='br-int',has_traffic_filtering=True,id=8682c013-92cc-4a9a-bb77-a69abc07cd0c,network=Network(bcfa8713-5d16-4fec-bd15-9084b98de4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8682c013-92')
Aug 27 03:53:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVFDMfqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:53:08 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:53:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfbdbc7-5c2a-4b4b-a8ed-86f6b010f1b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dbf83b-6870-4b48-91ee-458a161019ff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:53:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:53:09 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:53:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f42ef250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2851a1fb-fa03-4aed-940d-bf2ab9e520e5]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb84b964-2cab-4c17-ab4a-79066d453197]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[26965a07-1cd2-436e-be25-8b5d6cdf52c1]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2a65f3-3560-4740-b394-e51749dcc289]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dc56e8-66f9-4039-8dd7-222ab773c7f8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d436a421-899c-4e09-8715-33d6d9f6d344]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260]
Aug 27 03:53:09 user nova-compute[72990]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0, portal: 172.16.0.220,3260] successful.
Aug 27 03:53:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3798f977-b6a9-4589-a6a5-b28f7ea136a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[153b3f35-c96f-4a28-befd-26581b7fdb5a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] <== disconnect_volume: return (354ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:53:09 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Deleting instance files /opt/stack/data/nova/instances/c540f8c5-8827-4991-bee7-e2fce0c2d978_del
Aug 27 03:53:09 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Deletion of /opt/stack/data/nova/instances/c540f8c5-8827-4991-bee7-e2fce0c2d978_del complete
Aug 27 03:53:09 user nova-compute[72990]: INFO nova.compute.manager [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 27 03:53:09 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:53:09 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:53:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-d0afc7ca-2abd-4e17-8088-dc6e7f422c51 req-601d9688-e114-43e7-8735-f995aeb56136 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d0afc7ca-2abd-4e17-8088-dc6e7f422c51 req-601d9688-e114-43e7-8735-f995aeb56136 service nova] Acquiring lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d0afc7ca-2abd-4e17-8088-dc6e7f422c51 req-601d9688-e114-43e7-8735-f995aeb56136 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d0afc7ca-2abd-4e17-8088-dc6e7f422c51 req-601d9688-e114-43e7-8735-f995aeb56136 service nova] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-d0afc7ca-2abd-4e17-8088-dc6e7f422c51 req-601d9688-e114-43e7-8735-f995aeb56136 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] No waiting events found dispatching network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:53:10 user nova-compute[72990]: WARNING nova.compute.manager [req-d0afc7ca-2abd-4e17-8088-dc6e7f422c51 req-601d9688-e114-43e7-8735-f995aeb56136 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received unexpected event network-vif-plugged-8682c013-92cc-4a9a-bb77-a69abc07cd0c for instance with vm_state active and task_state deleting.
Aug 27 03:53:11 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:53:11 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Took 1.63 seconds to deallocate network for instance.
Aug 27 03:53:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-b132000c-c178-4c19-a32a-d4604662d854 req-14b2c4f9-b27a-4fcd-90de-60a01bdc75b8 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Received event network-vif-deleted-8682c013-92cc-4a9a-bb77-a69abc07cd0c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:11 user nova-compute[72990]: INFO nova.compute.manager [req-b132000c-c178-4c19-a32a-d4604662d854 req-14b2c4f9-b27a-4fcd-90de-60a01bdc75b8 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Neutron deleted interface 8682c013-92cc-4a9a-bb77-a69abc07cd0c; detaching it from the instance and deleting it from the info cache
Aug 27 03:53:11 user nova-compute[72990]: DEBUG nova.network.neutron [req-b132000c-c178-4c19-a32a-d4604662d854 req-14b2c4f9-b27a-4fcd-90de-60a01bdc75b8 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:53:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-b132000c-c178-4c19-a32a-d4604662d854 req-14b2c4f9-b27a-4fcd-90de-60a01bdc75b8 service nova] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Detach interface failed, port_id=8682c013-92cc-4a9a-bb77-a69abc07cd0c, reason: Instance c540f8c5-8827-4991-bee7-e2fce0c2d978 could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:53:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:11 user nova-compute[72990]: INFO nova.compute.manager [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Took 0.87 seconds to detach 1 volumes for instance.
Aug 27 03:53:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Deleting volume: 3798f977-b6a9-4589-a6a5-b28f7ea136a0 {{(pid=72990) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 03:53:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:13 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:53:13 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:53:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.260s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:13 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Deleted allocations for instance c540f8c5-8827-4991-bee7-e2fce0c2d978
Aug 27 03:53:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9f207b43-41c8-4ff5-9b91-2a667c508298 tempest-ServerActionsV293TestJSON-46885198 tempest-ServerActionsV293TestJSON-46885198-project-member] Lock "c540f8c5-8827-4991-bee7-e2fce0c2d978" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.309s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-8dfda751-c0c5-4974-b759-0485a3e02fcd req-de5d27e1-f5f0-47fe-b8b8-2293f3c95090 service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Received event network-changed-4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-8dfda751-c0c5-4974-b759-0485a3e02fcd req-de5d27e1-f5f0-47fe-b8b8-2293f3c95090 service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Refreshing instance network info cache due to event network-changed-4a10f523-8f08-4a62-aceb-64c206940996. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:53:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8dfda751-c0c5-4974-b759-0485a3e02fcd req-de5d27e1-f5f0-47fe-b8b8-2293f3c95090 service nova] Acquiring lock "refresh_cache-a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:53:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8dfda751-c0c5-4974-b759-0485a3e02fcd req-de5d27e1-f5f0-47fe-b8b8-2293f3c95090 service nova] Acquired lock "refresh_cache-a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:53:14 user nova-compute[72990]: DEBUG nova.network.neutron [req-8dfda751-c0c5-4974-b759-0485a3e02fcd req-de5d27e1-f5f0-47fe-b8b8-2293f3c95090 service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Refreshing network info cache for port 4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:53:15 user nova-compute[72990]: DEBUG nova.network.neutron [req-8dfda751-c0c5-4974-b759-0485a3e02fcd req-de5d27e1-f5f0-47fe-b8b8-2293f3c95090 service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Updated VIF entry in instance network info cache for port 4a10f523-8f08-4a62-aceb-64c206940996. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:53:15 user nova-compute[72990]: DEBUG nova.network.neutron [req-8dfda751-c0c5-4974-b759-0485a3e02fcd req-de5d27e1-f5f0-47fe-b8b8-2293f3c95090 service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Updating instance_info_cache with network_info: [{"id": "4a10f523-8f08-4a62-aceb-64c206940996", "address": "fa:16:3e:1c:b7:5d", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a10f523-8f", "ovs_interfaceid": "4a10f523-8f08-4a62-aceb-64c206940996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:53:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8dfda751-c0c5-4974-b759-0485a3e02fcd req-de5d27e1-f5f0-47fe-b8b8-2293f3c95090 service nova] Releasing lock "refresh_cache-a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:53:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG nova.objects.instance [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'flavor' on Instance uuid a0800495-d65a-4cdc-95d7-b0e0d07e3e5d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:19 user nova-compute[72990]: INFO nova.compute.manager [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Attaching volume d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 to /dev/vdb
Aug 27 03:53:19 user nova-compute[72990]: DEBUG os_brick.utils [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd26e3b-d190-4045-9a95-5b0b5026098e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d549fbd8-f03f-46d0-a167-b0190626d8b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fbabe7-5a2b-4ffd-a53c-36f8174c1e58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c046e5-d46b-470e-9aec-608ff2dd8838]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:53:19 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:53:19 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0f785e-2cd2-46be-86c5-4f5a5aea6f0d]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG os_brick.utils [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:53:19 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Updating existing volume attachment record: 57a2ed0d-308d-42d7-a007-b1c805563a0c {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:53:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:23 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108388.903824, c540f8c5-8827-4991-bee7-e2fce0c2d978 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:53:23 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] VM Stopped (Lifecycle Event)
Aug 27 03:53:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b1ef3d40-795b-4e92-8053-2507c2417beb None None] [instance: c540f8c5-8827-4991-bee7-e2fce0c2d978] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:53:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:25 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:53:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:28 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:53:28 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:53:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:29 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:53:30 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:53:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:53:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:53:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:31 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:53:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:53:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QiJUwDuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:53:32 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:53:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:53:32 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:53:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:53:32 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfafbba-35be-47ce-8fa7-03d5e1e32321]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:53:32 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8fac9f-952e-4a4f-b580-0b6025d6dc84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990] added
Aug 27 03:53:32 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fd6cb0-1749-4025-bdfb-053df4dab8c9]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[812469e3-d992-4574-bf2c-44f7d78e95d7]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QiJUwDuA {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QiJUwDuA" returned: 0 in 0.033s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[631079bf-9e66-4a8d-9a5c-7c554d92d682]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QiJUwDuA'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa6d6ea-0287-4a41-b891-da150a0fd3c9]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf8273a-8ac2-47c6-8bcf-cffdebd93d3d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a89b676-6409-40fe-b5b9-2f7af649b5e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990, portal: 172.16.0.220,3260]
Aug 27 03:53:33 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990, portal: 172.16.0.220,3260] successful.
Aug 27 03:53:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fd7cb8-7843-4b98-874c-c74fc143481b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4647d9-c8a6-4ca3-9163-685db3ad850f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 (non-flash)
Aug 27 03:53:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f17912a-54ca-4baf-97b0-bc4697302f49]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QiJUwDuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26634653539623138', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634653539623138', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG nova.objects.instance [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'flavor' on Instance uuid a0800495-d65a-4cdc-95d7-b0e0d07e3e5d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:53:34 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:53:34 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 03:53:34 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:53:34 user nova-compute[72990]:   <serial>d57e2ef4-6d4d-4698-a915-c9aeb9ccf990</serial>
Aug 27 03:53:34 user nova-compute[72990]: </disk>
Aug 27 03:53:34 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] No VIF found with MAC fa:16:3e:1c:b7:5d, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1ed6caee-180a-4cb5-a43d-3a850af3ca9a tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.085s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:53:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:53:36 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:53:36 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=6810MB free_disk=25.050750732421875GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:36 user nova-compute[72990]: INFO nova.compute.manager [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Detaching volume d57e2ef4-6d4d-4698-a915-c9aeb9ccf990
Aug 27 03:53:36 user nova-compute[72990]: INFO nova.virt.block_device [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Attempting to driver detach volume d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 from mountpoint /dev/vdb
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Attempting to detach device vdb from instance a0800495-d65a-4cdc-95d7-b0e0d07e3e5d from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:53:36 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:53:36 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 03:53:36 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:53:36 user nova-compute[72990]:   <serial>d57e2ef4-6d4d-4698-a915-c9aeb9ccf990</serial>
Aug 27 03:53:36 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:53:36 user nova-compute[72990]: </disk>
Aug 27 03:53:36 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:53:36 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully detached device vdb from instance a0800495-d65a-4cdc-95d7-b0e0d07e3e5d from the persistent domain config.
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0800495-d65a-4cdc-95d7-b0e0d07e3e5d from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:53:36 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:53:36 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 03:53:36 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:53:36 user nova-compute[72990]:   <serial>d57e2ef4-6d4d-4698-a915-c9aeb9ccf990</serial>
Aug 27 03:53:36 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:53:36 user nova-compute[72990]: </disk>
Aug 27 03:53:36 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 6a44010b-9a96-4343-a35c-1f212d21e47b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 15a88698-88d1-4c6b-9e40-98b618978a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 338682cb-8c70-49c3-b88c-362e96ec8fb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance a0800495-d65a-4cdc-95d7-b0e0d07e3e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aa475371-4888-4c4b-9b74-4e813b804da6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 250288e9-5421-4757-9258-fa1cf0c3be2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance d4f94cba-21ec-42a8-babc-859becde2c82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:53:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693108417.3050423, a0800495-d65a-4cdc-95d7-b0e0d07e3e5d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0800495-d65a-4cdc-95d7-b0e0d07e3e5d {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:53:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully detached device vdb from instance a0800495-d65a-4cdc-95d7-b0e0d07e3e5d from the live domain config.
Aug 27 03:53:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QiJUwDuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:53:37 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.769s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2082ee5-353d-4e2e-8628-25d295ab302f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bb4606-1826-4172-83bd-bfb23132e79b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 (non-flash)
Aug 27 03:53:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:53:37 user nova-compute[72990]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 (non-flash)
Aug 27 03:53:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7143cbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6c54e1-d51e-4843-baf3-69cc22602155]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30e60ad-2b26-4eb8-8f1c-4815ec8cf7b9]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[54147245-f5fc-4800-8ec8-1f256e15030e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23907de-be18-4df7-a8d5-15caf724b660]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36905c4-3b98-43d7-8777-d5486f4f84e0]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2345831c-bb86-40ee-9df9-077bad299a7c]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990, portal: 172.16.0.220,3260]
Aug 27 03:53:37 user nova-compute[72990]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990, portal: 172.16.0.220,3260] successful.
Aug 27 03:53:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d57e2ef4-6d4d-4698-a915-c9aeb9ccf990 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cf5c40-1cc6-470c-85a0-a3f5656b928e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] <== disconnect_volume: return (334ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:53:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:53:38 user nova-compute[72990]: DEBUG nova.objects.instance [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'flavor' on Instance uuid a0800495-d65a-4cdc-95d7-b0e0d07e3e5d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-43c14b30-7619-4a93-95dd-f4a354616e21 tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.006s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:39 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:53:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:53:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:53:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:53:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:53:40 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Updating instance_info_cache with network_info: [{"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:53:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-7114903d-465a-4ef6-b436-88af52261eae" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:53:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:53:40 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:53:40 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:53:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-309e17ee-3bfb-45d9-9811-1bfb2833eb0d req-47418e69-fb04-427b-8470-bf00beb0d241 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-changed-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-309e17ee-3bfb-45d9-9811-1bfb2833eb0d req-47418e69-fb04-427b-8470-bf00beb0d241 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Refreshing instance network info cache due to event network-changed-47395266-6458-4699-96ce-7a0d176dc6ac. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:53:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-309e17ee-3bfb-45d9-9811-1bfb2833eb0d req-47418e69-fb04-427b-8470-bf00beb0d241 service nova] Acquiring lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:53:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-309e17ee-3bfb-45d9-9811-1bfb2833eb0d req-47418e69-fb04-427b-8470-bf00beb0d241 service nova] Acquired lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:53:43 user nova-compute[72990]: DEBUG nova.network.neutron [req-309e17ee-3bfb-45d9-9811-1bfb2833eb0d req-47418e69-fb04-427b-8470-bf00beb0d241 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Refreshing network info cache for port 47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:53:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "aa475371-4888-4c4b-9b74-4e813b804da6" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:43 user nova-compute[72990]: INFO nova.compute.manager [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Shelve offloading
Aug 27 03:53:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:44 user nova-compute[72990]: DEBUG nova.network.neutron [req-309e17ee-3bfb-45d9-9811-1bfb2833eb0d req-47418e69-fb04-427b-8470-bf00beb0d241 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updated VIF entry in instance network info cache for port 47395266-6458-4699-96ce-7a0d176dc6ac. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:53:44 user nova-compute[72990]: DEBUG nova.network.neutron [req-309e17ee-3bfb-45d9-9811-1bfb2833eb0d req-47418e69-fb04-427b-8470-bf00beb0d241 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updating instance_info_cache with network_info: [{"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:53:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-309e17ee-3bfb-45d9-9811-1bfb2833eb0d req-47418e69-fb04-427b-8470-bf00beb0d241 service nova] Releasing lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:53:44 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Instance destroyed successfully.
Aug 27 03:53:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:53:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:53:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquired lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:53:44 user nova-compute[72990]: DEBUG nova.network.neutron [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:53:44 user nova-compute[72990]: DEBUG nova.network.neutron [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updating instance_info_cache with network_info: [{"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:53:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Releasing lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-dd824ce3-9892-4c73-8dab-af8108a9528e req-0f17a962-94e3-4a3d-afb9-2c9bfe422fa8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-vif-unplugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd824ce3-9892-4c73-8dab-af8108a9528e req-0f17a962-94e3-4a3d-afb9-2c9bfe422fa8 service nova] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd824ce3-9892-4c73-8dab-af8108a9528e req-0f17a962-94e3-4a3d-afb9-2c9bfe422fa8 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd824ce3-9892-4c73-8dab-af8108a9528e req-0f17a962-94e3-4a3d-afb9-2c9bfe422fa8 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-dd824ce3-9892-4c73-8dab-af8108a9528e req-0f17a962-94e3-4a3d-afb9-2c9bfe422fa8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] No waiting events found dispatching network-vif-unplugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:53:45 user nova-compute[72990]: WARNING nova.compute.manager [req-dd824ce3-9892-4c73-8dab-af8108a9528e req-0f17a962-94e3-4a3d-afb9-2c9bfe422fa8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received unexpected event network-vif-unplugged-47395266-6458-4699-96ce-7a0d176dc6ac for instance with vm_state active and task_state shelving.
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-dd824ce3-9892-4c73-8dab-af8108a9528e req-0f17a962-94e3-4a3d-afb9-2c9bfe422fa8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd824ce3-9892-4c73-8dab-af8108a9528e req-0f17a962-94e3-4a3d-afb9-2c9bfe422fa8 service nova] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd824ce3-9892-4c73-8dab-af8108a9528e req-0f17a962-94e3-4a3d-afb9-2c9bfe422fa8 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dd824ce3-9892-4c73-8dab-af8108a9528e req-0f17a962-94e3-4a3d-afb9-2c9bfe422fa8 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-dd824ce3-9892-4c73-8dab-af8108a9528e req-0f17a962-94e3-4a3d-afb9-2c9bfe422fa8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] No waiting events found dispatching network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:53:45 user nova-compute[72990]: WARNING nova.compute.manager [req-dd824ce3-9892-4c73-8dab-af8108a9528e req-0f17a962-94e3-4a3d-afb9-2c9bfe422fa8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received unexpected event network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac for instance with vm_state active and task_state shelving.
Aug 27 03:53:45 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Instance destroyed successfully.
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.objects.instance [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lazy-loading 'resources' on Instance uuid aa475371-4888-4c4b-9b74-4e813b804da6 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1204888072',display_name='tempest-TestShelveInstance-server-1204888072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1204888072',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODV3Eri2dz2QHD+ZkoRXONy+eMUQH4dVucSwROfVAI7uHKjkcKJQ36vL0D2hVAPAob00hmgbkYOFlwA0UkWtUYMQOIanoWC+2Pla6BWL/YN26BBCZtlxP3wx1JEWrSQ/w==',key_name='tempest-TestShelveInstance-2100279265',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35b53f8f3359444bbc0ef845387a827a',ramdisk_id='',reservation_id='r-lglgy4lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1842874330',owner_user_name='tempest-TestShelveInstance-1842874330-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:52:12Z,user_data=None,user_id='e2aa172fbf7844d390e285244a4f3799',uuid=aa475371-4888-4c4b-9b74-4e813b804da6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Converting VIF {"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_vif [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47395266-64, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-c158bbc2-ae35-462c-9eca-676f62339bd5 req-cb256247-dd31-4eaa-b4fc-beec9d0c69e8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-changed-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-c158bbc2-ae35-462c-9eca-676f62339bd5 req-cb256247-dd31-4eaa-b4fc-beec9d0c69e8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Refreshing instance network info cache due to event network-changed-47395266-6458-4699-96ce-7a0d176dc6ac. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c158bbc2-ae35-462c-9eca-676f62339bd5 req-cb256247-dd31-4eaa-b4fc-beec9d0c69e8 service nova] Acquiring lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c158bbc2-ae35-462c-9eca-676f62339bd5 req-cb256247-dd31-4eaa-b4fc-beec9d0c69e8 service nova] Acquired lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-c158bbc2-ae35-462c-9eca-676f62339bd5 req-cb256247-dd31-4eaa-b4fc-beec9d0c69e8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Refreshing network info cache for port 47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:53:45 user nova-compute[72990]: INFO os_vif [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64')
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcKDWLfy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:53:45 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[77747b4c-0517-4b31-a485-a77fa90f2a00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db4dc07-6de3-419b-9a29-1023d68ad5f0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:53:45 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:53:45 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:53:45 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:53:45 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:53:45 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:53:45 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:53:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:53:45 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:53:45 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:53:45 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:53:45 user nova-compute[72990]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:53:45 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:53:45 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:53:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44de170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083'): ({'sde'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Removing single pathed devices sde {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b0d86b-61ce-4348-a72d-472aac3e59d7]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c7616b-31e1-4d3d-8ae4-3e49179240a7]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Flushing IO for device /dev/sde {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[30717a05-18f6-447b-bf10-25cac126c5d5]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[263cb2b1-99ef-4d86-80b6-db73ec7259b0]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] SCSI volumes sde have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5bf6f2-37e8-436d-9592-34b1340647ed]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6144cd-0452-4779-831f-a54f2416fc76]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260]
Aug 27 03:53:45 user nova-compute[72990]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260] successful.
Aug 27 03:53:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[323bb2f0-f0a9-4c87-90f8-555a20bb6365]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] <== disconnect_volume: return (320ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:53:45 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Deleting instance files /opt/stack/data/nova/instances/aa475371-4888-4c4b-9b74-4e813b804da6_del
Aug 27 03:53:45 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Deletion of /opt/stack/data/nova/instances/aa475371-4888-4c4b-9b74-4e813b804da6_del complete
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-c158bbc2-ae35-462c-9eca-676f62339bd5 req-cb256247-dd31-4eaa-b4fc-beec9d0c69e8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updated VIF entry in instance network info cache for port 47395266-6458-4699-96ce-7a0d176dc6ac. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-c158bbc2-ae35-462c-9eca-676f62339bd5 req-cb256247-dd31-4eaa-b4fc-beec9d0c69e8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updating instance_info_cache with network_info: [{"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": null, "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap47395266-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:53:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c158bbc2-ae35-462c-9eca-676f62339bd5 req-cb256247-dd31-4eaa-b4fc-beec9d0c69e8 service nova] Releasing lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:53:46 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Deleted allocations for instance aa475371-4888-4c4b-9b74-4e813b804da6
Aug 27 03:53:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:46 user nova-compute[72990]: DEBUG nova.objects.instance [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lazy-loading 'numa_topology' on Instance uuid aa475371-4888-4c4b-9b74-4e813b804da6 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:46 user nova-compute[72990]: DEBUG nova.objects.base [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Object Instance<aa475371-4888-4c4b-9b74-4e813b804da6> lazy-loaded attributes: resources,numa_topology {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:53:47 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:53:47 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:53:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b82f990d-4059-47c4-9621-ad8b63933ff5 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "aa475371-4888-4c4b-9b74-4e813b804da6" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.897s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:47 user nova-compute[72990]: INFO nova.compute.manager [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Rescuing
Aug 27 03:53:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "refresh_cache-250288e9-5421-4757-9258-fa1cf0c3be2f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:53:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquired lock "refresh_cache-250288e9-5421-4757-9258-fa1cf0c3be2f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:53:47 user nova-compute[72990]: DEBUG nova.network.neutron [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:53:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:48 user nova-compute[72990]: DEBUG nova.network.neutron [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Updating instance_info_cache with network_info: [{"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:53:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Releasing lock "refresh_cache-250288e9-5421-4757-9258-fa1cf0c3be2f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:53:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-d2f376cb-2bef-40b2-beed-dd8a2d645ef6 req-b029970a-4f89-4660-b878-841b1705b3ab service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-unplugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d2f376cb-2bef-40b2-beed-dd8a2d645ef6 req-b029970a-4f89-4660-b878-841b1705b3ab service nova] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d2f376cb-2bef-40b2-beed-dd8a2d645ef6 req-b029970a-4f89-4660-b878-841b1705b3ab service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d2f376cb-2bef-40b2-beed-dd8a2d645ef6 req-b029970a-4f89-4660-b878-841b1705b3ab service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-d2f376cb-2bef-40b2-beed-dd8a2d645ef6 req-b029970a-4f89-4660-b878-841b1705b3ab service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] No waiting events found dispatching network-vif-unplugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:53:48 user nova-compute[72990]: WARNING nova.compute.manager [req-d2f376cb-2bef-40b2-beed-dd8a2d645ef6 req-b029970a-4f89-4660-b878-841b1705b3ab service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received unexpected event network-vif-unplugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 for instance with vm_state active and task_state rescuing.
Aug 27 03:53:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:48 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Instance destroyed successfully.
Aug 27 03:53:48 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Attempting a stable device rescue
Aug 27 03:53:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72990) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 03:53:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Instance directory exists: not creating {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 03:53:48 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Creating image(s)
Aug 27 03:53:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "/opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "/opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "/opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:49 user nova-compute[72990]: DEBUG nova.objects.instance [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'trusted_certs' on Instance uuid 250288e9-5421-4757-9258-fa1cf0c3be2f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "3fe3d489931cd5e32427da7f63558a60e37c0c00" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "3fe3d489931cd5e32427da7f63558a60e37c0c00" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.005s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00.part --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00.part --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG nova.virt.images [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] e9e943ad-efce-4cf4-b3c8-3fc6fd136d6c was qcow2, converting to raw {{(pid=72990) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00.part /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00.converted {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-d196f4eb-3389-4fad-ad8b-3289cc4eeb5a req-4dfae3e7-5d14-4309-98b8-0cb529a02710 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d196f4eb-3389-4fad-ad8b-3289cc4eeb5a req-4dfae3e7-5d14-4309-98b8-0cb529a02710 service nova] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d196f4eb-3389-4fad-ad8b-3289cc4eeb5a req-4dfae3e7-5d14-4309-98b8-0cb529a02710 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d196f4eb-3389-4fad-ad8b-3289cc4eeb5a req-4dfae3e7-5d14-4309-98b8-0cb529a02710 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-d196f4eb-3389-4fad-ad8b-3289cc4eeb5a req-4dfae3e7-5d14-4309-98b8-0cb529a02710 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] No waiting events found dispatching network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:53:50 user nova-compute[72990]: WARNING nova.compute.manager [req-d196f4eb-3389-4fad-ad8b-3289cc4eeb5a req-4dfae3e7-5d14-4309-98b8-0cb529a02710 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received unexpected event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 for instance with vm_state active and task_state rescuing.
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00.part /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00.converted" returned: 0 in 0.299s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00.converted --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "3fe3d489931cd5e32427da7f63558a60e37c0c00" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.810s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "3fe3d489931cd5e32427da7f63558a60e37c0c00" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "3fe3d489931cd5e32427da7f63558a60e37c0c00" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00 --force-share --output=json" returned: 0 in 0.174s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00,backing_fmt=raw /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.rescue {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00,backing_fmt=raw /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.rescue" returned: 0 in 0.052s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "3fe3d489931cd5e32427da7f63558a60e37c0c00" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.objects.instance [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'migration_context' on Instance uuid 250288e9-5421-4757-9258-fa1cf0c3be2f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.objects.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Object Instance<250288e9-5421-4757-9258-fa1cf0c3be2f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Start _get_guest_xml network_info=[{"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "vif_mac": "fa:16:3e:81:0c:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e9e943ad-efce-4cf4-b3c8-3fc6fd136d6c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '7184ee7e-7b6f-48fc-af9a-b487f6caf55f', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMWzfXqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '250288e9-5421-4757-9258-fa1cf0c3be2f', 'attached_at': '', 'detached_at': '', 'volume_id': '9abacf48-09ce-40ba-8934-9b6d50bfe212', 'serial': '9abacf48-09ce-40ba-8934-9b6d50bfe212'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.objects.instance [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'resources' on Instance uuid 250288e9-5421-4757-9258-fa1cf0c3be2f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.objects.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Object Instance<250288e9-5421-4757-9258-fa1cf0c3be2f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.objects.instance [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'numa_topology' on Instance uuid 250288e9-5421-4757-9258-fa1cf0c3be2f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.objects.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Object Instance<250288e9-5421-4757-9258-fa1cf0c3be2f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:53:51 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:53:51 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.objects.instance [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'vcpu_model' on Instance uuid 250288e9-5421-4757-9258-fa1cf0c3be2f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.objects.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Object Instance<250288e9-5421-4757-9258-fa1cf0c3be2f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMWzfXqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:53:51 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:53:51 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:53:51 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d7895f-e468-41ea-af25-11fc50aa0076]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dMWzfXqR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 03:53:51 user nova-compute[72990]: node.name = iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212
Aug 27 03:53:51 user nova-compute[72990]: node.tpgt = -1
Aug 27 03:53:51 user nova-compute[72990]: node.startup = automatic
Aug 27 03:53:51 user nova-compute[72990]: node.leading_login = No
Aug 27 03:53:51 user nova-compute[72990]: iface.iscsi_ifacename = default
Aug 27 03:53:51 user nova-compute[72990]: iface.net_ifacename = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.ipaddress = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.prefix_len = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.hwaddress = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.transport_name = tcp
Aug 27 03:53:51 user nova-compute[72990]: iface.initiatorname = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.state = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.vlan_id = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.vlan_priority = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.vlan_state = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.iface_num = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.mtu = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.port = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.bootproto = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.subnet_mask = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.gateway = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.dhcp_alt_client_id = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.dhcp_dns = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.dhcp_learn_iqn = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.dhcp_vendor_id_state = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.dhcp_vendor_id = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.dhcp_slp_da = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.fragmentation = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.gratuitous_arp = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.incoming_forwarding = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.tos_state = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.tos = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.ttl = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.delayed_ack = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.tcp_nagle = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.tcp_wsf_state = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.tcp_wsf = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.tcp_timer_scale = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.tcp_timestamp = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.redirect = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.def_task_mgmt_timeout = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.header_digest = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.data_digest = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.immediate_data = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.initial_r2t = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.data_seq_inorder = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.data_pdu_inorder = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.erl = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.max_receive_data_len = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.first_burst_len = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.max_outstanding_r2t = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.max_burst_len = 0
Aug 27 03:53:51 user nova-compute[72990]: iface.chap_auth = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.bidi_chap = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.strict_login_compliance = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.discovery_auth = <empty>
Aug 27 03:53:51 user nova-compute[72990]: iface.discovery_logout = <empty>
Aug 27 03:53:51 user nova-compute[72990]: node.discovery_address = <empty>
Aug 27 03:53:51 user nova-compute[72990]: node.discovery_port = 0
Aug 27 03:53:51 user nova-compute[72990]: node.discovery_type = static
Aug 27 03:53:51 user nova-compute[72990]: node.session.initial_cmdsn = 0
Aug 27 03:53:51 user nova-compute[72990]: node.session.initial_login_retry_max = 8
Aug 27 03:53:51 user nova-compute[72990]: node.session.xmit_thread_priority = -20
Aug 27 03:53:51 user nova-compute[72990]: node.session.cmds_max = 128
Aug 27 03:53:51 user nova-compute[72990]: node.session.queue_depth = 32
Aug 27 03:53:51 user nova-compute[72990]: node.session.nr_sessions = 1
Aug 27 03:53:51 user nova-compute[72990]: node.session.auth.authmethod = CHAP
Aug 27 03:53:51 user nova-compute[72990]: node.session.auth.username = dMWzfXqR
Aug 27 03:53:51 user nova-compute[72990]: node.session.auth.password = ***
Aug 27 03:53:51 user nova-compute[72990]: node.session.auth.username_in = <empty>
Aug 27 03:53:51 user nova-compute[72990]: node.session.auth.password_in = <empty>
Aug 27 03:53:51 user nova-compute[72990]: node.session.auth.chap_algs = MD5
Aug 27 03:53:51 user nova-compute[72990]: node.session.timeo.replacement_timeout = 120
Aug 27 03:53:51 user nova-compute[72990]: node.session.err_timeo.abort_timeout = 15
Aug 27 03:53:51 user nova-compute[72990]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 03:53:51 user nova-compute[72990]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 03:53:51 user nova-compute[72990]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 03:53:51 user nova-compute[72990]: node.session.iscsi.FastAbort = Yes
Aug 27 03:53:51 user nova-compute[72990]: node.session.iscsi.InitialR2T = No
Aug 27 03:53:51 user nova-compute[72990]: node.session.iscsi.ImmediateData = Yes
Aug 27 03:53:51 user nova-compute[72990]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 03:53:51 user nova-compute[72990]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 03:53:51 user nova-compute[72990]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 03:53:51 user nova-compute[72990]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 03:53:51 user nova-compute[72990]: node.session.iscsi.MaxConnections = 1
Aug 27 03:53:51 user nova-compute[72990]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 03:53:51 user nova-compute[72990]: node.session.iscsi.ERL = 0
Aug 27 03:53:51 user nova-compute[72990]: node.session.scan = manual
Aug 27 03:53:51 user nova-compute[72990]: node.session.reopen_max = 0
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].address = 172.16.0.220
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].port = 3260
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].startup = manual
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].tcp.window_size = 524288
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].tcp.type_of_service = 0
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].timeo.logout_timeout = 15
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].timeo.login_timeout = 15
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].timeo.auth_timeout = 45
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].iscsi.DataDigest = None
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].iscsi.IFMarker = No
Aug 27 03:53:51 user nova-compute[72990]: node.conn[0].iscsi.OFMarker = No
Aug 27 03:53:51 user nova-compute[72990]: # END RECORD
Aug 27 03:53:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e968e199-fa5a-4cbf-98cf-1b6b8fb0b68c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b7a094-5ddd-4a7a-aed7-288f63bed4db]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMWzfXqR {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMWzfXqR" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa33cc85-3695-4ab4-a259-5d2e03baeecf]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMWzfXqR'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc3ab18-c01c-483b-a086-0e330d9287c8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d750cb-d96f-42e2-9026-31259b3db0be]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:53:51 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:53:51 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:53:51 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:53:51 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:53:51 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:53:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:53:51 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:53:51 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:53:51 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:53:51 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:53:51 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:53:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.161s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] HCTL ('39', '0', '0', 0) found on session 30 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ecd446-c121-4598-86d8-7ca3ef254732]: (4, ('0 0 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Searching for a device in session 30 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMWzfXqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.187s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '23030663866626665', 'path': '/dev/sdh'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030663866626665', 'path': '/dev/sdh'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-46726741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-46726741',id=26,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-mfhlhcbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:52:34Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=250288e9-5421-4757-9258-fa1cf0c3be2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "vif_mac": "fa:16:3e:81:0c:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "vif_mac": "fa:16:3e:81:0c:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=f92099d9-a8e3-45fa-879a-40a71a5ca301,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92099d9-a8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.objects.instance [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'pci_devices' on Instance uuid 250288e9-5421-4757-9258-fa1cf0c3be2f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.objects.base [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Object Instance<250288e9-5421-4757-9258-fa1cf0c3be2f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:53:51 user nova-compute[72990]:   <uuid>250288e9-5421-4757-9258-fa1cf0c3be2f</uuid>
Aug 27 03:53:51 user nova-compute[72990]:   <name>instance-0000001a</name>
Aug 27 03:53:51 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:53:51 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:53:51 user nova-compute[72990]:   <metadata>
Aug 27 03:53:51 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:53:51 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:53:51 user nova-compute[72990]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-46726741</nova:name>
Aug 27 03:53:51 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:53:51</nova:creationTime>
Aug 27 03:53:51 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:53:51 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:53:51 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:53:51 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:53:51 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:53:51 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:53:51 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:53:51 user nova-compute[72990]:       <nova:owner>
Aug 27 03:53:51 user nova-compute[72990]:         <nova:user uuid="858a63e8d5964f38ad776985cfbe9121">tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member</nova:user>
Aug 27 03:53:51 user nova-compute[72990]:         <nova:project uuid="183297ba5b6549fdb39f2135d92b3794">tempest-ServerBootFromVolumeStableRescueTest-1839224225</nova:project>
Aug 27 03:53:51 user nova-compute[72990]:       </nova:owner>
Aug 27 03:53:51 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:53:51 user nova-compute[72990]:       <nova:ports>
Aug 27 03:53:51 user nova-compute[72990]:         <nova:port uuid="f92099d9-a8e3-45fa-879a-40a71a5ca301">
Aug 27 03:53:51 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 03:53:51 user nova-compute[72990]:         </nova:port>
Aug 27 03:53:51 user nova-compute[72990]:       </nova:ports>
Aug 27 03:53:51 user nova-compute[72990]:     </nova:instance>
Aug 27 03:53:51 user nova-compute[72990]:   </metadata>
Aug 27 03:53:51 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:53:51 user nova-compute[72990]:     <system>
Aug 27 03:53:51 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:53:51 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:53:51 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:53:51 user nova-compute[72990]:       <entry name="serial">250288e9-5421-4757-9258-fa1cf0c3be2f</entry>
Aug 27 03:53:51 user nova-compute[72990]:       <entry name="uuid">250288e9-5421-4757-9258-fa1cf0c3be2f</entry>
Aug 27 03:53:51 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:53:51 user nova-compute[72990]:     </system>
Aug 27 03:53:51 user nova-compute[72990]:   </sysinfo>
Aug 27 03:53:51 user nova-compute[72990]:   <os>
Aug 27 03:53:51 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:53:51 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:53:51 user nova-compute[72990]:   </os>
Aug 27 03:53:51 user nova-compute[72990]:   <features>
Aug 27 03:53:51 user nova-compute[72990]:     <acpi/>
Aug 27 03:53:51 user nova-compute[72990]:     <apic/>
Aug 27 03:53:51 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:53:51 user nova-compute[72990]:   </features>
Aug 27 03:53:51 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:53:51 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:53:51 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:53:51 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:53:51 user nova-compute[72990]:   </clock>
Aug 27 03:53:51 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:53:51 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:53:51 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:53:51 user nova-compute[72990]:   </cpu>
Aug 27 03:53:51 user nova-compute[72990]:   <devices>
Aug 27 03:53:51 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:53:51 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:53:51 user nova-compute[72990]:       <source dev="/dev/sdh"/>
Aug 27 03:53:51 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:53:51 user nova-compute[72990]:       <serial>9abacf48-09ce-40ba-8934-9b6d50bfe212</serial>
Aug 27 03:53:51 user nova-compute[72990]:     </disk>
Aug 27 03:53:51 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:53:51 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:53:51 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.rescue"/>
Aug 27 03:53:51 user nova-compute[72990]:       <target dev="vdb" bus="virtio"/>
Aug 27 03:53:51 user nova-compute[72990]:       <boot order="1"/>
Aug 27 03:53:51 user nova-compute[72990]:     </disk>
Aug 27 03:53:51 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:53:51 user nova-compute[72990]:       <mac address="fa:16:3e:81:0c:0f"/>
Aug 27 03:53:51 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:53:51 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:53:51 user nova-compute[72990]:       <target dev="tapf92099d9-a8"/>
Aug 27 03:53:51 user nova-compute[72990]:     </interface>
Aug 27 03:53:51 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:53:51 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/console.log" append="off"/>
Aug 27 03:53:51 user nova-compute[72990]:     </serial>
Aug 27 03:53:51 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:53:51 user nova-compute[72990]:     <video>
Aug 27 03:53:51 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:53:51 user nova-compute[72990]:     </video>
Aug 27 03:53:51 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:53:51 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:53:51 user nova-compute[72990]:     </rng>
Aug 27 03:53:51 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:53:51 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:53:51 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:53:51 user nova-compute[72990]:     </memballoon>
Aug 27 03:53:51 user nova-compute[72990]:   </devices>
Aug 27 03:53:51 user nova-compute[72990]: </domain>
Aug 27 03:53:51 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:53:51 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Instance destroyed successfully.
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:53:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] No VIF found with MAC fa:16:3e:81:0c:0f, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:53:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-d448812c-a058-47cf-959c-85b7ae83900a req-1870740f-cfc1-428a-8d82-71a165b26b47 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d448812c-a058-47cf-959c-85b7ae83900a req-1870740f-cfc1-428a-8d82-71a165b26b47 service nova] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d448812c-a058-47cf-959c-85b7ae83900a req-1870740f-cfc1-428a-8d82-71a165b26b47 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d448812c-a058-47cf-959c-85b7ae83900a req-1870740f-cfc1-428a-8d82-71a165b26b47 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-d448812c-a058-47cf-959c-85b7ae83900a req-1870740f-cfc1-428a-8d82-71a165b26b47 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] No waiting events found dispatching network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:53:53 user nova-compute[72990]: WARNING nova.compute.manager [req-d448812c-a058-47cf-959c-85b7ae83900a req-1870740f-cfc1-428a-8d82-71a165b26b47 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received unexpected event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 for instance with vm_state active and task_state rescuing.
Aug 27 03:53:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "1e214476-7101-478d-9091-a3ddb56f9307" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:53:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:54 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:53:54 user nova-compute[72990]: INFO nova.compute.claims [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Claim successful on node user
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9a9701ad-7618-48b9-a87f-39687373f404 req-d38407b7-cc0e-47bc-afde-e356eb4f5579 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9a9701ad-7618-48b9-a87f-39687373f404 req-d38407b7-cc0e-47bc-afde-e356eb4f5579 service nova] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9a9701ad-7618-48b9-a87f-39687373f404 req-d38407b7-cc0e-47bc-afde-e356eb4f5579 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9a9701ad-7618-48b9-a87f-39687373f404 req-d38407b7-cc0e-47bc-afde-e356eb4f5579 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9a9701ad-7618-48b9-a87f-39687373f404 req-d38407b7-cc0e-47bc-afde-e356eb4f5579 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] No waiting events found dispatching network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:53:55 user nova-compute[72990]: WARNING nova.compute.manager [req-9a9701ad-7618-48b9-a87f-39687373f404 req-d38407b7-cc0e-47bc-afde-e356eb4f5579 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received unexpected event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 for instance with vm_state active and task_state rescuing.
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Removed pending event for 250288e9-5421-4757-9258-fa1cf0c3be2f due to event {{(pid=72990) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108435.1183593, 250288e9-5421-4757-9258-fa1cf0c3be2f => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:53:55 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] VM Resumed (Lifecycle Event)
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-998d785c-5e23-49d3-b32f-01e51db64446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:53:55 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108435.1185083, 250288e9-5421-4757-9258-fa1cf0c3be2f => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:53:55 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] VM Started (Lifecycle Event)
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:53:55 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:53:55 user nova-compute[72990]: INFO nova.virt.block_device [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Booting with volume fe96fc7b-e462-48e7-9786-853341ffcac8 at /dev/vda
Aug 27 03:53:55 user nova-compute[72990]: DEBUG os_brick.utils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG nova.policy [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97e7e38d016f42cdada7214766a153be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dab62a21d64da685223dcf47c8e957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[561ddfb6-1a72-4919-8211-740a50383992]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fbd71f-726c-47bb-b6b3-ba9c2f210236]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda23742-2df3-4317-adc4-4fd8129a271a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2245582-a41c-491c-a0a0-f6743d73985a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:53:56 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:53:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35afd12-c9f0-4f02-b018-3f3d3bf62ea0]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG os_brick.utils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating existing volume attachment record: 8d04c6b2-3bec-490c-a39f-d37f6fef2f27 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-b0bfc404-6e22-4686-94b8-d0be316a870b req-56196efd-284f-468f-88cb-4169da0dba1d service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-changed-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-b0bfc404-6e22-4686-94b8-d0be316a870b req-56196efd-284f-468f-88cb-4169da0dba1d service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Refreshing instance network info cache due to event network-changed-778be9fb-ea44-464a-b5a7-aea387c1aded. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b0bfc404-6e22-4686-94b8-d0be316a870b req-56196efd-284f-468f-88cb-4169da0dba1d service nova] Acquiring lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b0bfc404-6e22-4686-94b8-d0be316a870b req-56196efd-284f-468f-88cb-4169da0dba1d service nova] Acquired lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:53:56 user nova-compute[72990]: DEBUG nova.network.neutron [req-b0bfc404-6e22-4686-94b8-d0be316a870b req-56196efd-284f-468f-88cb-4169da0dba1d service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Refreshing network info cache for port 778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:53:57 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Successfully created port: 0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:53:57 user nova-compute[72990]: DEBUG nova.network.neutron [req-b0bfc404-6e22-4686-94b8-d0be316a870b req-56196efd-284f-468f-88cb-4169da0dba1d service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updated VIF entry in instance network info cache for port 778be9fb-ea44-464a-b5a7-aea387c1aded. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:53:57 user nova-compute[72990]: DEBUG nova.network.neutron [req-b0bfc404-6e22-4686-94b8-d0be316a870b req-56196efd-284f-468f-88cb-4169da0dba1d service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updating instance_info_cache with network_info: [{"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:53:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b0bfc404-6e22-4686-94b8-d0be316a870b req-56196efd-284f-468f-88cb-4169da0dba1d service nova] Releasing lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:53:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:53:57 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Successfully created port: 5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:53:59 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Successfully created port: 673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:53:59 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108424.2652094, aa475371-4888-4c4b-9b74-4e813b804da6 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:53:59 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] VM Stopped (Lifecycle Event)
Aug 27 03:53:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7e2ceb13-48d3-4e64-8b84-74dc686a864e None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:54:00 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Successfully created port: ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:54:00 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:01 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Successfully created port: 98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:54:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:02 user nova-compute[72990]: INFO nova.compute.manager [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Shelving
Aug 27 03:54:02 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Successfully updated port: 0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:54:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-f683aa10-07a4-4f6b-9e95-3f8e403cf73f req-9e45a4c9-bfd5-4a88-97ad-a512c54be15d service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-changed-0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-f683aa10-07a4-4f6b-9e95-3f8e403cf73f req-9e45a4c9-bfd5-4a88-97ad-a512c54be15d service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing instance network info cache due to event network-changed-0c20a87d-20ab-48b0-925a-34cc951b54ba. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:54:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f683aa10-07a4-4f6b-9e95-3f8e403cf73f req-9e45a4c9-bfd5-4a88-97ad-a512c54be15d service nova] Acquiring lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f683aa10-07a4-4f6b-9e95-3f8e403cf73f req-9e45a4c9-bfd5-4a88-97ad-a512c54be15d service nova] Acquired lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:02 user nova-compute[72990]: DEBUG nova.network.neutron [req-f683aa10-07a4-4f6b-9e95-3f8e403cf73f req-9e45a4c9-bfd5-4a88-97ad-a512c54be15d service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing network info cache for port 0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:54:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:03 user nova-compute[72990]: DEBUG nova.network.neutron [req-f683aa10-07a4-4f6b-9e95-3f8e403cf73f req-9e45a4c9-bfd5-4a88-97ad-a512c54be15d service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:54:03 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Instance destroyed successfully.
Aug 27 03:54:03 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Beginning cold snapshot process
Aug 27 03:54:03 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:54:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk /opt/stack/data/nova/instances/snapshots/tmpddcaaa5d/62083ef8ae1146f399a79c006c3166cb {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG nova.network.neutron [req-f683aa10-07a4-4f6b-9e95-3f8e403cf73f req-9e45a4c9-bfd5-4a88-97ad-a512c54be15d service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f683aa10-07a4-4f6b-9e95-3f8e403cf73f req-9e45a4c9-bfd5-4a88-97ad-a512c54be15d service nova] Releasing lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk /opt/stack/data/nova/instances/snapshots/tmpddcaaa5d/62083ef8ae1146f399a79c006c3166cb" returned: 0 in 0.737s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:04 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Snapshot extracted, beginning image upload
Aug 27 03:54:04 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Successfully updated port: 91208a0e-6d0b-4af4-9996-a282702c92af {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-vif-unplugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] No waiting events found dispatching network-vif-unplugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:04 user nova-compute[72990]: WARNING nova.compute.manager [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received unexpected event network-vif-unplugged-778be9fb-ea44-464a-b5a7-aea387c1aded for instance with vm_state active and task_state shelving_image_uploading.
Aug 27 03:54:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] No waiting events found dispatching network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:04 user nova-compute[72990]: WARNING nova.compute.manager [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received unexpected event network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded for instance with vm_state active and task_state shelving_image_uploading.
Aug 27 03:54:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-changed-91208a0e-6d0b-4af4-9996-a282702c92af {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing instance network info cache due to event network-changed-91208a0e-6d0b-4af4-9996-a282702c92af. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] Acquiring lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] Acquired lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:04 user nova-compute[72990]: DEBUG nova.network.neutron [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing network info cache for port 91208a0e-6d0b-4af4-9996-a282702c92af {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:54:05 user nova-compute[72990]: DEBUG nova.network.neutron [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:54:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:05 user nova-compute[72990]: DEBUG nova.network.neutron [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bedf0236-2c8e-4287-b21f-6e4e59928d54 req-3a7d2493-0a01-4642-8ed1-061aea378c86 service nova] Releasing lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:06 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Successfully updated port: 33321514-f420-4c28-b775-13ef897aa0ef {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-19b78a93-d834-4611-b52c-963bcfe55597 req-04f10beb-2311-40ff-933f-91164a0e6935 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-changed-33321514-f420-4c28-b775-13ef897aa0ef {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-19b78a93-d834-4611-b52c-963bcfe55597 req-04f10beb-2311-40ff-933f-91164a0e6935 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing instance network info cache due to event network-changed-33321514-f420-4c28-b775-13ef897aa0ef. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-19b78a93-d834-4611-b52c-963bcfe55597 req-04f10beb-2311-40ff-933f-91164a0e6935 service nova] Acquiring lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-19b78a93-d834-4611-b52c-963bcfe55597 req-04f10beb-2311-40ff-933f-91164a0e6935 service nova] Acquired lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG nova.network.neutron [req-19b78a93-d834-4611-b52c-963bcfe55597 req-04f10beb-2311-40ff-933f-91164a0e6935 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing network info cache for port 33321514-f420-4c28-b775-13ef897aa0ef {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG nova.network.neutron [req-19b78a93-d834-4611-b52c-963bcfe55597 req-04f10beb-2311-40ff-933f-91164a0e6935 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG nova.network.neutron [req-19b78a93-d834-4611-b52c-963bcfe55597 req-04f10beb-2311-40ff-933f-91164a0e6935 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Successfully updated port: 5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-19b78a93-d834-4611-b52c-963bcfe55597 req-04f10beb-2311-40ff-933f-91164a0e6935 service nova] Releasing lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:07 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Snapshot image upload complete
Aug 27 03:54:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:54:07 user nova-compute[72990]: INFO nova.compute.manager [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Shelve offloading
Aug 27 03:54:07 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Instance destroyed successfully.
Aug 27 03:54:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquired lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:07 user nova-compute[72990]: DEBUG nova.network.neutron [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:54:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-372b544c-3e56-45d9-a710-56df26787205 req-25d03a1f-cf7c-4946-9514-6eb6ce539539 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-changed-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-372b544c-3e56-45d9-a710-56df26787205 req-25d03a1f-cf7c-4946-9514-6eb6ce539539 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing instance network info cache due to event network-changed-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:54:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-372b544c-3e56-45d9-a710-56df26787205 req-25d03a1f-cf7c-4946-9514-6eb6ce539539 service nova] Acquiring lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-372b544c-3e56-45d9-a710-56df26787205 req-25d03a1f-cf7c-4946-9514-6eb6ce539539 service nova] Acquired lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:09 user nova-compute[72990]: DEBUG nova.network.neutron [req-372b544c-3e56-45d9-a710-56df26787205 req-25d03a1f-cf7c-4946-9514-6eb6ce539539 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing network info cache for port 5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:54:09 user nova-compute[72990]: DEBUG nova.network.neutron [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updating instance_info_cache with network_info: [{"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:09 user nova-compute[72990]: DEBUG nova.network.neutron [req-372b544c-3e56-45d9-a710-56df26787205 req-25d03a1f-cf7c-4946-9514-6eb6ce539539 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:54:09 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Successfully updated port: 673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:54:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Releasing lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:09 user nova-compute[72990]: DEBUG nova.network.neutron [req-372b544c-3e56-45d9-a710-56df26787205 req-25d03a1f-cf7c-4946-9514-6eb6ce539539 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-372b544c-3e56-45d9-a710-56df26787205 req-25d03a1f-cf7c-4946-9514-6eb6ce539539 service nova] Releasing lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:10 user nova-compute[72990]: INFO nova.virt.block_device [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Booting with volume 07aa8dc4-38b8-4b06-b244-c161b498550c at /dev/vdb
Aug 27 03:54:10 user nova-compute[72990]: DEBUG os_brick.utils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[579ebc14-02ea-41bf-8bc7-d798183a5c2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.035s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f66b5f-3d22-40b1-9e40-9a4ddadf6f2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:10 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Instance destroyed successfully.
Aug 27 03:54:10 user nova-compute[72990]: DEBUG nova.objects.instance [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'resources' on Instance uuid f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e5af55-43b8-49b0-9417-62906813a0be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-886886887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-886886887',id=27,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb4gesZwfxCDTM0W9aM+C7He0/Aub6UyHKYOgf/t95RKC8+hn/x/f9jOtmOwHySm1O9Cjsn9zMaKpYpEKkII5kNwunF1+RbMLEgByZl4DzqWanUzIfy5QW0JU1Qa09bcg==',key_name='tempest-keypair-631728363',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bd44d92dded643eb89d955dbf6b4d1e3',ramdisk_id='',reservation_id='r-nh5nv47v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2085503517',owner_user_name='tempest-AttachVolumeShelveTestJSON-2085503517-project-member',shelved_at='2023-08-27T03:54:07.860742',shelved_host='user',shelved_image_id='0820b467-d4d2-45fc-802e-598c03ea7eba'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:54:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be8e872f1de4248a557155ff1c4f5ec',uuid=f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converting VIF {"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG os_vif [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b286bf-d064-4c8f-9867-567edb582040]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap778be9fb-ea, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:10 user nova-compute[72990]: INFO os_vif [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea')
Aug 27 03:54:10 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Deleting instance files /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d_del
Aug 27 03:54:10 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Deletion of /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d_del complete
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:54:10 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cb4085-754a-4660-a14c-22e89f67b273]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG os_brick.utils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating existing volume attachment record: 0715f8d3-c86b-4b66-8146-a82c9a1a1153 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Successfully updated port: ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:54:10 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Deleted allocations for instance f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG nova.objects.instance [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'numa_topology' on Instance uuid f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:54:10 user nova-compute[72990]: DEBUG nova.objects.base [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Object Instance<f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d> lazy-loaded attributes: resources,numa_topology {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-changed-673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing instance network info cache due to event network-changed-673498bd-0a4d-499d-8aaf-1bd148132f98. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] Acquiring lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] Acquired lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG nova.network.neutron [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing network info cache for port 673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG nova.network.neutron [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-84581885-d1ad-4543-99ea-715c56b6d631 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.698s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG nova.network.neutron [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] Releasing lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-changed-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Refreshing instance network info cache due to event network-changed-778be9fb-ea44-464a-b5a7-aea387c1aded. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] Acquiring lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] Acquired lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:11 user nova-compute[72990]: DEBUG nova.network.neutron [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Refreshing network info cache for port 778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:54:12 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Successfully updated port: 98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:54:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquired lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:12 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:54:12 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:54:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:12 user nova-compute[72990]: DEBUG nova.network.neutron [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updated VIF entry in instance network info cache for port 778be9fb-ea44-464a-b5a7-aea387c1aded. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:54:12 user nova-compute[72990]: DEBUG nova.network.neutron [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updating instance_info_cache with network_info: [{"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap778be9fb-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] Releasing lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:12 user nova-compute[72990]: DEBUG nova.compute.manager [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-changed-ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:12 user nova-compute[72990]: DEBUG nova.compute.manager [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing instance network info cache due to event network-changed-ed12bcc2-2daf-47c0-8571-ac118426948c. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:54:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] Acquiring lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-139f9159-c2d3-4a8e-add3-3a33ab4b9ba8 req-a5485ba0-bc65-4fcd-b3e3-24836055cd3b service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-changed-98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-139f9159-c2d3-4a8e-add3-3a33ab4b9ba8 req-a5485ba0-bc65-4fcd-b3e3-24836055cd3b service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing instance network info cache due to event network-changed-98474278-76fb-4c4a-933c-9cde3c86f3d5. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:54:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-139f9159-c2d3-4a8e-add3-3a33ab4b9ba8 req-a5485ba0-bc65-4fcd-b3e3-24836055cd3b service nova] Acquiring lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:15 user nova-compute[72990]: DEBUG nova.network.neutron [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [{"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "673498bd-0a4d-499d-8aaf-1bd148132f98", "address": "fa:16:3e:2b:c9:8c", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673498bd-0a", "ovs_interfaceid": "673498bd-0a4d-499d-8aaf-1bd148132f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Releasing lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:15 user nova-compute[72990]: DEBUG nova.compute.manager [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Instance network_info: |[{"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "673498bd-0a4d-499d-8aaf-1bd148132f98", "address": "fa:16:3e:2b:c9:8c", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673498bd-0a", "ovs_interfaceid": "673498bd-0a4d-499d-8aaf-1bd148132f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:54:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] Acquired lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:15 user nova-compute[72990]: DEBUG nova.network.neutron [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing network info cache for port ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:54:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:15 user nova-compute[72990]: DEBUG nova.network.neutron [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updated VIF entry in instance network info cache for port ed12bcc2-2daf-47c0-8571-ac118426948c. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:54:15 user nova-compute[72990]: DEBUG nova.network.neutron [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [{"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "673498bd-0a4d-499d-8aaf-1bd148132f98", "address": "fa:16:3e:2b:c9:8c", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673498bd-0a", "ovs_interfaceid": "673498bd-0a4d-499d-8aaf-1bd148132f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-219da24d-16e8-4908-b0ba-5ddbe068f52a req-cfb63933-d120-472a-b9f7-92d25d17d422 service nova] Releasing lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-139f9159-c2d3-4a8e-add3-3a33ab4b9ba8 req-a5485ba0-bc65-4fcd-b3e3-24836055cd3b service nova] Acquired lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:15 user nova-compute[72990]: DEBUG nova.network.neutron [req-139f9159-c2d3-4a8e-add3-3a33ab4b9ba8 req-a5485ba0-bc65-4fcd-b3e3-24836055cd3b service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing network info cache for port 98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:54:16 user nova-compute[72990]: DEBUG nova.network.neutron [req-139f9159-c2d3-4a8e-add3-3a33ab4b9ba8 req-a5485ba0-bc65-4fcd-b3e3-24836055cd3b service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updated VIF entry in instance network info cache for port 98474278-76fb-4c4a-933c-9cde3c86f3d5. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:54:16 user nova-compute[72990]: DEBUG nova.network.neutron [req-139f9159-c2d3-4a8e-add3-3a33ab4b9ba8 req-a5485ba0-bc65-4fcd-b3e3-24836055cd3b service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [{"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "673498bd-0a4d-499d-8aaf-1bd148132f98", "address": "fa:16:3e:2b:c9:8c", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673498bd-0a", "ovs_interfaceid": "673498bd-0a4d-499d-8aaf-1bd148132f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-139f9159-c2d3-4a8e-add3-3a33ab4b9ba8 req-a5485ba0-bc65-4fcd-b3e3-24836055cd3b service nova] Releasing lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:18 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108443.5657728, f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:54:18 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] VM Stopped (Lifecycle Event)
Aug 27 03:54:18 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ff5adb2f-1275-4459-af70-12ff9d080127 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:54:19 user nova-compute[72990]: DEBUG nova.compute.manager [req-ce731c9f-b566-4597-ba70-df7a442aa342 req-11864d77-fe91-424c-b659-87c10cfb5b40 service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Received event network-changed-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:19 user nova-compute[72990]: DEBUG nova.compute.manager [req-ce731c9f-b566-4597-ba70-df7a442aa342 req-11864d77-fe91-424c-b659-87c10cfb5b40 service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Refreshing instance network info cache due to event network-changed-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:54:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ce731c9f-b566-4597-ba70-df7a442aa342 req-11864d77-fe91-424c-b659-87c10cfb5b40 service nova] Acquiring lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ce731c9f-b566-4597-ba70-df7a442aa342 req-11864d77-fe91-424c-b659-87c10cfb5b40 service nova] Acquired lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:19 user nova-compute[72990]: DEBUG nova.network.neutron [req-ce731c9f-b566-4597-ba70-df7a442aa342 req-11864d77-fe91-424c-b659-87c10cfb5b40 service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Refreshing network info cache for port 7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:54:20 user nova-compute[72990]: DEBUG nova.network.neutron [req-ce731c9f-b566-4597-ba70-df7a442aa342 req-11864d77-fe91-424c-b659-87c10cfb5b40 service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updated VIF entry in instance network info cache for port 7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:54:20 user nova-compute[72990]: DEBUG nova.network.neutron [req-ce731c9f-b566-4597-ba70-df7a442aa342 req-11864d77-fe91-424c-b659-87c10cfb5b40 service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updating instance_info_cache with network_info: [{"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ce731c9f-b566-4597-ba70-df7a442aa342 req-11864d77-fe91-424c-b659-87c10cfb5b40 service nova] Releasing lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Stashing vm_state: active {{(pid=72990) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 27 03:54:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:21 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:54:21 user nova-compute[72990]: INFO nova.compute.claims [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Claim successful on node user
Aug 27 03:54:21 user nova-compute[72990]: INFO nova.compute.resource_tracker [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updating resource usage from migration 12409cc1-101b-4d76-bc54-53f0a795232c
Aug 27 03:54:21 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:54:21 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:54:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.512s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:21 user nova-compute[72990]: INFO nova.compute.manager [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Migrating
Aug 27 03:54:21 user nova-compute[72990]: DEBUG nova.compute.manager [req-965cf7bb-6e56-46fb-b789-fb09d97270f5 req-48bc5eb2-4684-4370-b88d-44c4f28e8499 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received event network-changed-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:21 user nova-compute[72990]: DEBUG nova.compute.manager [req-965cf7bb-6e56-46fb-b789-fb09d97270f5 req-48bc5eb2-4684-4370-b88d-44c4f28e8499 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Refreshing instance network info cache due to event network-changed-a9b2e415-e44f-4302-9a4a-6b079b3b4c29. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:54:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-965cf7bb-6e56-46fb-b789-fb09d97270f5 req-48bc5eb2-4684-4370-b88d-44c4f28e8499 service nova] Acquiring lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-965cf7bb-6e56-46fb-b789-fb09d97270f5 req-48bc5eb2-4684-4370-b88d-44c4f28e8499 service nova] Acquired lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:21 user nova-compute[72990]: DEBUG nova.network.neutron [req-965cf7bb-6e56-46fb-b789-fb09d97270f5 req-48bc5eb2-4684-4370-b88d-44c4f28e8499 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Refreshing network info cache for port a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:54:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:22 user nova-compute[72990]: DEBUG nova.network.neutron [req-965cf7bb-6e56-46fb-b789-fb09d97270f5 req-48bc5eb2-4684-4370-b88d-44c4f28e8499 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updated VIF entry in instance network info cache for port a9b2e415-e44f-4302-9a4a-6b079b3b4c29. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:54:22 user nova-compute[72990]: DEBUG nova.network.neutron [req-965cf7bb-6e56-46fb-b789-fb09d97270f5 req-48bc5eb2-4684-4370-b88d-44c4f28e8499 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updating instance_info_cache with network_info: [{"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-965cf7bb-6e56-46fb-b789-fb09d97270f5 req-48bc5eb2-4684-4370-b88d-44c4f28e8499 service nova] Releasing lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquired lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:54:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updating instance_info_cache with network_info: [{"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Releasing lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Starting migrate_disk_and_power_off {{(pid=72990) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:23 user nova-compute[72990]: INFO nova.virt.block_device [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Booting with volume d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 at /dev/vdc
Aug 27 03:54:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.utils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7919d8a-ad1c-43ea-863f-0c407650b120]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Instance destroyed successfully.
Aug 27 03:54:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1658965801',display_name='tempest-ServerActionsTestOtherA-server-1658965801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1658965801',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx4YMOpiFApd+UuDRSLGi+Pmb0zohcJr1O+wFKm9ZeByZUcToOSr5LVAydvhFQAlBpKXomrxo0iOLbfaHvfjryxwDtlu2Xqz9AegDptkwou3u7ClkNhexzzpMlOVgjY6Q==',key_name='tempest-keypair-749840506',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-k1hscn8l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:54:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=d4f94cba-21ec-42a8-babc-859becde2c82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1848835739-network", "vif_mac": "fa:16:3e:fb:cc:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1848835739-network", "vif_mac": "fa:16:3e:fb:cc:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_vif [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9b2e415-e4, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fe2142-6ef3-4525-8e3c-ad714a7fe4d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:23 user nova-compute[72990]: INFO os_vif [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4')
Aug 27 03:54:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcdBbxJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:54:23 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c036267-ec99-4f89-bdaa-6f9e602062c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b8512d-68bb-413d-b353-f1a7a9a90b1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[36227c15-eb21-4a1a-aa43-67eabdd26fbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:54:23 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7428770-6571-4aea-a56f-c0870ed1a139]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.utils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating existing volume attachment record: 8716b42c-7fae-4ae3-ae57-f52ece3636a7 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-8cd17e01-e6e9-4b94-85ac-77c7d5d0631b req-d7532487-c1d9-4227-8baa-4afb5f3c7073 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received event network-vif-unplugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8cd17e01-e6e9-4b94-85ac-77c7d5d0631b req-d7532487-c1d9-4227-8baa-4afb5f3c7073 service nova] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8cd17e01-e6e9-4b94-85ac-77c7d5d0631b req-d7532487-c1d9-4227-8baa-4afb5f3c7073 service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8cd17e01-e6e9-4b94-85ac-77c7d5d0631b req-d7532487-c1d9-4227-8baa-4afb5f3c7073 service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-8cd17e01-e6e9-4b94-85ac-77c7d5d0631b req-d7532487-c1d9-4227-8baa-4afb5f3c7073 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] No waiting events found dispatching network-vif-unplugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:23 user nova-compute[72990]: WARNING nova.compute.manager [req-8cd17e01-e6e9-4b94-85ac-77c7d5d0631b req-d7532487-c1d9-4227-8baa-4afb5f3c7073 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received unexpected event network-vif-unplugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 for instance with vm_state active and task_state resize_migrating.
Aug 27 03:54:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-8cd17e01-e6e9-4b94-85ac-77c7d5d0631b req-d7532487-c1d9-4227-8baa-4afb5f3c7073 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received event network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8cd17e01-e6e9-4b94-85ac-77c7d5d0631b req-d7532487-c1d9-4227-8baa-4afb5f3c7073 service nova] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8cd17e01-e6e9-4b94-85ac-77c7d5d0631b req-d7532487-c1d9-4227-8baa-4afb5f3c7073 service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8cd17e01-e6e9-4b94-85ac-77c7d5d0631b req-d7532487-c1d9-4227-8baa-4afb5f3c7073 service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-8cd17e01-e6e9-4b94-85ac-77c7d5d0631b req-d7532487-c1d9-4227-8baa-4afb5f3c7073 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] No waiting events found dispatching network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:23 user nova-compute[72990]: WARNING nova.compute.manager [req-8cd17e01-e6e9-4b94-85ac-77c7d5d0631b req-d7532487-c1d9-4227-8baa-4afb5f3c7073 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received unexpected event network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 for instance with vm_state active and task_state resize_migrating.
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d22b59-0322-4c62-9908-0888ec87cc64]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:23 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:23 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:23 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:54:23 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:23 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:54:23 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:23 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:23 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:23 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:54:23 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:23 user nova-compute[72990]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:54:23 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44df640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363'): ({'sdi'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Removing single pathed devices sdi {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac31594-cdca-48a7-8a40-727a949841e3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[34349b08-4adf-4a87-8225-f17ea5688d23]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flushing IO for device /dev/sdi {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf930551-a3bf-4619-9710-41090520c23f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f66ead-03b5-4782-895a-178ab8195262]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] SCSI volumes sdi have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:54:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[292dc96c-18ef-4775-8aef-63fab410793b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c6e424-5c9a-4e72-bdc2-935399256eb4]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260]
Aug 27 03:54:24 user nova-compute[72990]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260] successful.
Aug 27 03:54:24 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[34af24ea-c8cb-4e20-a0ea-9bc5e3384d7d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== disconnect_volume: return (404ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:54:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:54:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Port a9b2e415-e44f-4302-9a4a-6b079b3b4c29 binding to destination host user is already ACTIVE {{(pid=72990) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 03:54:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquired lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updating instance_info_cache with network_info: [{"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:26 user nova-compute[72990]: INFO nova.compute.manager [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Terminating instance
Aug 27 03:54:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Releasing lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG os_brick.utils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe93a1b-ae25-4209-ab8c-5da8be9967d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c44748d-507b-413f-ade8-4ffda2e734be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d69d62-7d3e-41a2-b032-e8a0a566cb6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adabb44-562f-4424-8799-e49eaf4ee8e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:54:26 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:54:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f98f247-827d-4b2e-afed-c592319ce23f]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:54:26 user nova-compute[72990]: DEBUG os_brick.utils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-1222f720-340a-4779-a714-693844e35e4f req-9441dcef-68c9-4afb-b635-08775982135f service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Received event network-vif-unplugged-4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1222f720-340a-4779-a714-693844e35e4f req-9441dcef-68c9-4afb-b635-08775982135f service nova] Acquiring lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1222f720-340a-4779-a714-693844e35e4f req-9441dcef-68c9-4afb-b635-08775982135f service nova] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1222f720-340a-4779-a714-693844e35e4f req-9441dcef-68c9-4afb-b635-08775982135f service nova] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-1222f720-340a-4779-a714-693844e35e4f req-9441dcef-68c9-4afb-b635-08775982135f service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] No waiting events found dispatching network-vif-unplugged-4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-1222f720-340a-4779-a714-693844e35e4f req-9441dcef-68c9-4afb-b635-08775982135f service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Received event network-vif-unplugged-4a10f523-8f08-4a62-aceb-64c206940996 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:54:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Instance destroyed successfully.
Aug 27 03:54:27 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lazy-loading 'resources' on Instance uuid a0800495-d65a-4cdc-95d7-b0e0d07e3e5d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-947241680',display_name='tempest-AttachVolumeNegativeTest-server-947241680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-947241680',id=24,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3JmHVj1/lz5OMpw1A2/JvMQbwGumKMpTMQneI1Zr16KcG1HWkzucFcL/Sqtt81tasQEUDVtXCi+nj4XToswS4oTaNvI5cpZ6lZCLATKmAM2b0YylHMRg4IHK2+qoqCAg==',key_name='tempest-keypair-1412787747',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:51:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d007a65dbbce40729d2d7a25561a4f91',ramdisk_id='',reservation_id='r-u1abenk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-945598863',owner_user_name='tempest-AttachVolumeNegativeTest-945598863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:51:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7d2fc4d4204ad38d0d11376de45bd6',uuid=a0800495-d65a-4cdc-95d7-b0e0d07e3e5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a10f523-8f08-4a62-aceb-64c206940996", "address": "fa:16:3e:1c:b7:5d", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a10f523-8f", "ovs_interfaceid": "4a10f523-8f08-4a62-aceb-64c206940996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converting VIF {"id": "4a10f523-8f08-4a62-aceb-64c206940996", "address": "fa:16:3e:1c:b7:5d", "network": {"id": "e6c5a29b-034f-46d4-ac0e-cbce88f46018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1860782481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d007a65dbbce40729d2d7a25561a4f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a10f523-8f", "ovs_interfaceid": "4a10f523-8f08-4a62-aceb-64c206940996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b7:5d,bridge_name='br-int',has_traffic_filtering=True,id=4a10f523-8f08-4a62-aceb-64c206940996,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a10f523-8f') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG os_vif [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b7:5d,bridge_name='br-int',has_traffic_filtering=True,id=4a10f523-8f08-4a62-aceb-64c206940996,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a10f523-8f') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a10f523-8f, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:27 user nova-compute[72990]: INFO os_vif [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b7:5d,bridge_name='br-int',has_traffic_filtering=True,id=4a10f523-8f08-4a62-aceb-64c206940996,network=Network(e6c5a29b-034f-46d4-ac0e-cbce88f46018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a10f523-8f')
Aug 27 03:54:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Deleting instance files /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d_del
Aug 27 03:54:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Deletion of /opt/stack/data/nova/instances/a0800495-d65a-4cdc-95d7-b0e0d07e3e5d_del complete
Aug 27 03:54:27 user nova-compute[72990]: INFO nova.compute.manager [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 27 03:54:27 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:54:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:28 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:28 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Took 0.96 seconds to deallocate network for instance.
Aug 27 03:54:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:28 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:54:28 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:54:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:28 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Deleted allocations for instance a0800495-d65a-4cdc-95d7-b0e0d07e3e5d
Aug 27 03:54:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f01d2ada-adc1-499a-81ae-57144a8a124f tempest-AttachVolumeNegativeTest-945598863 tempest-AttachVolumeNegativeTest-945598863-project-member] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.468s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-29e9a99c-aee2-4bd7-ace3-480eb38d1121 req-9d79c06f-e8f3-40b4-8654-53fd5e5e185e service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Received event network-vif-plugged-4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-29e9a99c-aee2-4bd7-ace3-480eb38d1121 req-9d79c06f-e8f3-40b4-8654-53fd5e5e185e service nova] Acquiring lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-29e9a99c-aee2-4bd7-ace3-480eb38d1121 req-9d79c06f-e8f3-40b4-8654-53fd5e5e185e service nova] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-29e9a99c-aee2-4bd7-ace3-480eb38d1121 req-9d79c06f-e8f3-40b4-8654-53fd5e5e185e service nova] Lock "a0800495-d65a-4cdc-95d7-b0e0d07e3e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-29e9a99c-aee2-4bd7-ace3-480eb38d1121 req-9d79c06f-e8f3-40b4-8654-53fd5e5e185e service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] No waiting events found dispatching network-vif-plugged-4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:29 user nova-compute[72990]: WARNING nova.compute.manager [req-29e9a99c-aee2-4bd7-ace3-480eb38d1121 req-9d79c06f-e8f3-40b4-8654-53fd5e5e185e service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Received unexpected event network-vif-plugged-4a10f523-8f08-4a62-aceb-64c206940996 for instance with vm_state deleted and task_state None.
Aug 27 03:54:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-29e9a99c-aee2-4bd7-ace3-480eb38d1121 req-9d79c06f-e8f3-40b4-8654-53fd5e5e185e service nova] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Received event network-vif-deleted-4a10f523-8f08-4a62-aceb-64c206940996 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:30 user nova-compute[72990]: INFO nova.compute.manager [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Terminating instance
Aug 27 03:54:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-1802634c-405a-4973-81c6-323cf99a7305 req-bc03b0bd-41bd-4caa-be79-07c4140f69bf service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-unplugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1802634c-405a-4973-81c6-323cf99a7305 req-bc03b0bd-41bd-4caa-be79-07c4140f69bf service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1802634c-405a-4973-81c6-323cf99a7305 req-bc03b0bd-41bd-4caa-be79-07c4140f69bf service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1802634c-405a-4973-81c6-323cf99a7305 req-bc03b0bd-41bd-4caa-be79-07c4140f69bf service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-1802634c-405a-4973-81c6-323cf99a7305 req-bc03b0bd-41bd-4caa-be79-07c4140f69bf service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-unplugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-1802634c-405a-4973-81c6-323cf99a7305 req-bc03b0bd-41bd-4caa-be79-07c4140f69bf service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-unplugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:30 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Instance destroyed successfully.
Aug 27 03:54:30 user nova-compute[72990]: DEBUG nova.objects.instance [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lazy-loading 'resources' on Instance uuid 338682cb-8c70-49c3-b88c-362e96ec8fb1 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2048756041',display_name='tempest-ServerActionsTestOtherB-server-2048756041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2048756041',id=18,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvV5/xdIrrMiR/5VLCxhM3KKboDXXvobrXZoxgpQUAOozywbLJ2xsxdUcEhJo7m/5kpTKUpySOn2yAwFLCYDLgNxiCX1IdtXhqxCfcecMFLg6qxM0T/ZTj+kDi4FnruVQ==',key_name='tempest-keypair-1100770948',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:52:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3efa88907cc54e01abeabdfb040a6d23',ramdisk_id='',reservation_id='r-v5k469oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-862895181',owner_user_name='tempest-ServerActionsTestOtherB-862895181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f71b8c6ad2624149b3760b97ab8a9e4a',uuid=338682cb-8c70-49c3-b88c-362e96ec8fb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converting VIF {"id": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "address": "fa:16:3e:94:53:13", "network": {"id": "1834bef3-9406-4681-b3c7-66e9d2cff11e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-207012819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efa88907cc54e01abeabdfb040a6d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f159e5-8c", "ovs_interfaceid": "09f159e5-8c35-4fa2-a2e9-873634e6a084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG os_vif [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09f159e5-8c, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:31 user nova-compute[72990]: INFO os_vif [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:53:13,bridge_name='br-int',has_traffic_filtering=True,id=09f159e5-8c35-4fa2-a2e9-873634e6a084,network=Network(1834bef3-9406-4681-b3c7-66e9d2cff11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f159e5-8c')
Aug 27 03:54:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knbmSeEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:54:31 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[262a10a7-d9f4-44a2-ae66-0447f00fc004]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f65820-3935-4aa1-9eb5-5d85525b3892]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:31 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:31 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:31 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:54:31 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:31 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:31 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:31 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:31 user nova-compute[72990]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba (non-flash)
Aug 27 03:54:31 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:31 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f430be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba'): ({'sdd'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Removing single pathed devices sdd {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6da274-b8a7-444d-aacb-dfbf662ffd32]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[475b5526-aaf4-4026-b099-1debf3ca0e2c]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Flushing IO for device /dev/sdd {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b2c01c-9ee1-4610-ba23-938e082aaa1b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[793c0f2f-f109-4456-8a2e-a3f284680b59]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b168e86-8f1e-411a-a5e7-f33f81f912eb]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eff4df4-4907-41d8-8b2a-5bab8dd011e3]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260]
Aug 27 03:54:31 user nova-compute[72990]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba, portal: 172.16.0.220,3260] successful.
Aug 27 03:54:31 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0edcdf64-da71-43a8-b27d-b9cc7a7bbeba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2419b7d8-b70e-495f-973b-058d71aef152]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] <== disconnect_volume: return (369ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:54:31 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Deleting instance files /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1_del
Aug 27 03:54:31 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Deletion of /opt/stack/data/nova/instances/338682cb-8c70-49c3-b88c-362e96ec8fb1_del complete
Aug 27 03:54:31 user nova-compute[72990]: INFO nova.compute.manager [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Took 1.40 seconds to destroy the instance on the hypervisor.
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:32 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Took 1.11 seconds to deallocate network for instance.
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-88c39d98-8a34-4d10-ac5e-5a4d7bf88f49 req-f42f6d66-ad22-4611-962e-be507bef0339 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-deleted-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:32 user nova-compute[72990]: WARNING nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state active and task_state deleting.
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:32 user nova-compute[72990]: WARNING nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state active and task_state deleting.
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:32 user nova-compute[72990]: WARNING nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state active and task_state deleting.
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-unplugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-unplugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-unplugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Acquiring lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] No waiting events found dispatching network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:32 user nova-compute[72990]: WARNING nova.compute.manager [req-91e1e5d8-8359-449e-a0f0-db025dbe2b1f req-07b4af5d-e750-4fd2-9a61-5b80df3cbe58 service nova] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Received unexpected event network-vif-plugged-09f159e5-8c35-4fa2-a2e9-873634e6a084 for instance with vm_state active and task_state deleting.
Aug 27 03:54:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:54:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:33 user nova-compute[72990]: INFO nova.compute.manager [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Took 0.91 seconds to detach 1 volumes for instance.
Aug 27 03:54:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:54:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.612s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:34 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Deleted allocations for instance 338682cb-8c70-49c3-b88c-362e96ec8fb1
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a0f827a6-4829-4022-9359-a2e4fe331272 tempest-ServerActionsTestOtherB-862895181 tempest-ServerActionsTestOtherB-862895181-project-member] Lock "338682cb-8c70-49c3-b88c-362e96ec8fb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.261s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:54:36 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:54:36 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:54:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7595MB free_disk=24.985145568847656GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:54:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Applying migration context for instance d4f94cba-21ec-42a8-babc-859becde2c82 as it has an incoming, in-progress migration 12409cc1-101b-4d76-bc54-53f0a795232c. Migration status is post-migrating {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 03:54:36 user nova-compute[72990]: INFO nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updating resource usage from migration 12409cc1-101b-4d76-bc54-53f0a795232c
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 6a44010b-9a96-4343-a35c-1f212d21e47b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 15a88698-88d1-4c6b-9e40-98b618978a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 250288e9-5421-4757-9258-fa1cf0c3be2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 1e214476-7101-478d-9091-a3ddb56f9307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Migration 12409cc1-101b-4d76-bc54-53f0a795232c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance d4f94cba-21ec-42a8-babc-859becde2c82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.717s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:54:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Creating image(s)
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Ensure instance console log exists: /opt/stack/data/nova/instances/1e214476-7101-478d-9091-a3ddb56f9307/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Start _get_guest_xml network_info=[{"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "673498bd-0a4d-499d-8aaf-1bd148132f98", "address": "fa:16:3e:2b:c9:8c", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673498bd-0a", "ovs_interfaceid": "673498bd-0a4d-499d-8aaf-1bd148132f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '8d04c6b2-3bec-490c-a39f-d37f6fef2f27', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZyShUnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e214476-7101-478d-9091-a3ddb56f9307', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe96fc7b-e462-48e7-9786-853341ffcac8', 'serial': 'fe96fc7b-e462-48e7-9786-853341ffcac8'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '0715f8d3-c86b-4b66-8146-a82c9a1a1153', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EchzrURT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e214476-7101-478d-9091-a3ddb56f9307', 'attached_at': '', 'detached_at': '', 'volume_id': '07aa8dc4-38b8-4b06-b244-c161b498550c', 'serial': '07aa8dc4-38b8-4b06-b244-c161b498550c'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '8716b42c-7fae-4ae3-ae57-f52ece3636a7', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTHgDmKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e214476-7101-478d-9091-a3ddb56f9307', 'attached_at': '', 'detached_at': '', 'volume_id': 'd70a5caa-0c7e-4185-b87f-9fcdb11f9dd2', 'serial': 'd70a5caa-0c7e-4185-b87f-9fcdb11f9dd2'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:54:37 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:54:37 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZyShUnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:54:37 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:54:37 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:54:37 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[256c2ba0-b5f0-427c-b8e6-eb42977192d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:54:37 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde05bea-5b19-4ebf-affa-2902b3921bf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8] added
Aug 27 03:54:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2c54fc-c5e7-492f-b9e2-9e13bac7b357]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a680005-71cf-4f63-b95e-3db52fc149b6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZyShUnE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZyShUnE" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50ad812-a36a-4425-b1a3-0c7ebf95725f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZyShUnE'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[904673a2-3e9b-41c2-9700-0b689f551d17]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3453a8-11cc-4b68-abad-7020de7672c5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[035322e9-c241-47ab-9d8a-1b26f54a36bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8, portal: 172.16.0.220,3260]
Aug 27 03:54:37 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8, portal: 172.16.0.220,3260] successful.
Aug 27 03:54:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4559dcb-4ab3-4531-86c3-4bf5c2efee01]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[390fcfca-a7fa-45e9-a858-37f5f765fa81]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:37 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:54:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[51af4bc2-9f01-435f-9942-53f15a42c9f4]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZyShUnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Didn't find any instances for network info cache update. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108463.7019901, d4f94cba-21ec-42a8-babc-859becde2c82 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:54:38 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] VM Stopped (Lifecycle Event)
Aug 27 03:54:38 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-e94b48b3-0cec-4cbc-9bce-724dbcd8d822 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:54:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-e94b48b3-0cec-4cbc-9bce-724dbcd8d822 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:54:38 user nova-compute[72990]: INFO nova.compute.manager [None req-e94b48b3-0cec-4cbc-9bce-724dbcd8d822 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26236346636343431', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236346636343431', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EchzrURT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:54:39 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:54:39 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:54:39 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c3a36f-c7bd-47af-9ca0-d132382072d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:54:39 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[61914d74-ac67-46c3-8a6e-897fedeb0ede]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c] added
Aug 27 03:54:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8b0bd3-6b2f-44f6-8796-e7c803c5046f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[22796814-0b6e-42c5-a47d-ede9eaac449c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EchzrURT {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EchzrURT" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[582c9819-f173-4361-bf81-e313c60bd915]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EchzrURT'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5132c83d-8840-4663-b711-f26fb9f236e6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae27a6b-88d8-4ef0-b203-ec9a4ce6d448]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ddb323-35c4-4850-a2f0-78bb7d52ba20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c, portal: 172.16.0.220,3260]
Aug 27 03:54:39 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c, portal: 172.16.0.220,3260] successful.
Aug 27 03:54:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc1c923-2642-4c91-ba4f-29e3380ac2e9]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd7f29-473b-4408-b4bd-6c2f146c0dd4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:54:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:39 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:54:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb981b8b-77cd-4a90-9614-7ec5a19218bf]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EchzrURT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23865343735373632', 'path': '/dev/sdd'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865343735373632', 'path': '/dev/sdd'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTHgDmKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:54:40 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:54:40 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:54:40 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b061a176-51e0-43e8-84f0-e39930ed9f8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:54:40 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[289fed9e-597a-452b-8f8c-8e83cfda3f59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2] added
Aug 27 03:54:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Starting finish_migration {{(pid=72990) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Instance directory exists: not creating {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 03:54:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Creating image(s)
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Ensure instance console log exists: /opt/stack/data/nova/instances/d4f94cba-21ec-42a8-babc-859becde2c82/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Start _get_guest_xml network_info=[{"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1848835739-network", "vif_mac": "fa:16:3e:fb:cc:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '89ccb118-4b2b-4d5f-838b-805aba439626', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcdBbxJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd4f94cba-21ec-42a8-babc-859becde2c82', 'attached_at': '2023-08-27T03:54:40.000000', 'detached_at': '', 'volume_id': 'a9e1e7bb-c0c9-4659-8796-97fded91b363', 'serial': 'a9e1e7bb-c0c9-4659-8796-97fded91b363'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f25325-8d54-4f1a-86db-d19e14312cd7]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:40 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:54:40 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcdBbxJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:54:40 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[014486f6-7b86-4e77-b47a-d68f480f5eea]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTHgDmKR {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTHgDmKR" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[167485f0-594a-40b0-8ad3-e7d3fea04d2c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTHgDmKR'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1631386d-db38-4b72-beb7-a15d30fdfc5e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deb293d-d8e6-48ae-8bfe-bd26e90ff5c1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:54:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:54:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[300673be-d7b6-4762-917a-04962083d1f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2, portal: 172.16.0.220,3260]
Aug 27 03:54:40 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2, portal: 172.16.0.220,3260] successful.
Aug 27 03:54:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08e8fc6-49a6-4531-9bd9-2ae916fef1c4]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae46017b-3952-4ba1-890a-20b313d01f61]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:54:40 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:54:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c4f28c-4678-44a1-84d3-4c1d1ca9747b]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:54:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTHgDmKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26133323564346334', 'path': '/dev/sde'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133323564346334', 'path': '/dev/sde'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.248s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:54:41 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:54:41 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:24:90,bridge_name='br-int',has_traffic_filtering=True,id=0c20a87d-20ab-48b0-925a-34cc951b54ba,network=Network(489e7ccb-0047-439d-b180-be939ef4c11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c20a87d-20') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:49:28,bridge_name='br-int',has_traffic_filtering=True,id=91208a0e-6d0b-4af4-9996-a282702c92af,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91208a0e-6d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e5:0d,bridge_name='br-int',has_traffic_filtering=True,id=33321514-f420-4c28-b775-13ef897aa0ef,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33321514-f4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6a:86,bridge_name='br-int',has_traffic_filtering=True,id=5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1bea33-f8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "673498bd-0a4d-499d-8aaf-1bd148132f98", "address": "fa:16:3e:2b:c9:8c", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673498bd-0a", "ovs_interfaceid": "673498bd-0a4d-499d-8aaf-1bd148132f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "673498bd-0a4d-499d-8aaf-1bd148132f98", "address": "fa:16:3e:2b:c9:8c", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673498bd-0a", "ovs_interfaceid": "673498bd-0a4d-499d-8aaf-1bd148132f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c9:8c,bridge_name='br-int',has_traffic_filtering=True,id=673498bd-0a4d-499d-8aaf-1bd148132f98,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673498bd-0a') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=ed12bcc2-2daf-47c0-8571-ac118426948c,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped12bcc2-2d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:f7,bridge_name='br-int',has_traffic_filtering=True,id=98474278-76fb-4c4a-933c-9cde3c86f3d5,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98474278-76') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.objects.instance [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e214476-7101-478d-9091-a3ddb56f9307 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[049c0927-0377-4dd9-8bcb-082bcd3596ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:54:41 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:54:41 user nova-compute[72990]:   <uuid>1e214476-7101-478d-9091-a3ddb56f9307</uuid>
Aug 27 03:54:41 user nova-compute[72990]:   <name>instance-0000001d</name>
Aug 27 03:54:41 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:54:41 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:54:41 user nova-compute[72990]:   <metadata>
Aug 27 03:54:41 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:54:41 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:54:41 user nova-compute[72990]:       <nova:name>tempest-device-tagging-server-873791915</nova:name>
Aug 27 03:54:41 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:54:37</nova:creationTime>
Aug 27 03:54:41 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:54:41 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:54:41 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:54:41 user nova-compute[72990]:       <nova:owner>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:user uuid="97e7e38d016f42cdada7214766a153be">tempest-TaggedBootDevicesTest-139511590-project-member</nova:user>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:project uuid="26dab62a21d64da685223dcf47c8e957">tempest-TaggedBootDevicesTest-139511590</nova:project>
Aug 27 03:54:41 user nova-compute[72990]:       </nova:owner>
Aug 27 03:54:41 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:54:41 user nova-compute[72990]:       <nova:ports>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:port uuid="0c20a87d-20ab-48b0-925a-34cc951b54ba">
Aug 27 03:54:41 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 03:54:41 user nova-compute[72990]:         </nova:port>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:port uuid="91208a0e-6d0b-4af4-9996-a282702c92af">
Aug 27 03:54:41 user nova-compute[72990]:           <nova:ip type="fixed" address="10.1.1.39" ipVersion="4"/>
Aug 27 03:54:41 user nova-compute[72990]:         </nova:port>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:port uuid="33321514-f420-4c28-b775-13ef897aa0ef">
Aug 27 03:54:41 user nova-compute[72990]:           <nova:ip type="fixed" address="10.1.1.137" ipVersion="4"/>
Aug 27 03:54:41 user nova-compute[72990]:         </nova:port>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:port uuid="5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c">
Aug 27 03:54:41 user nova-compute[72990]:           <nova:ip type="fixed" address="10.1.1.163" ipVersion="4"/>
Aug 27 03:54:41 user nova-compute[72990]:         </nova:port>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:port uuid="673498bd-0a4d-499d-8aaf-1bd148132f98">
Aug 27 03:54:41 user nova-compute[72990]:           <nova:ip type="fixed" address="10.1.1.164" ipVersion="4"/>
Aug 27 03:54:41 user nova-compute[72990]:         </nova:port>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:port uuid="ed12bcc2-2daf-47c0-8571-ac118426948c">
Aug 27 03:54:41 user nova-compute[72990]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 27 03:54:41 user nova-compute[72990]:         </nova:port>
Aug 27 03:54:41 user nova-compute[72990]:         <nova:port uuid="98474278-76fb-4c4a-933c-9cde3c86f3d5">
Aug 27 03:54:41 user nova-compute[72990]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 27 03:54:41 user nova-compute[72990]:         </nova:port>
Aug 27 03:54:41 user nova-compute[72990]:       </nova:ports>
Aug 27 03:54:41 user nova-compute[72990]:     </nova:instance>
Aug 27 03:54:41 user nova-compute[72990]:   </metadata>
Aug 27 03:54:41 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:54:41 user nova-compute[72990]:     <system>
Aug 27 03:54:41 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:54:41 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:54:41 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:54:41 user nova-compute[72990]:       <entry name="serial">1e214476-7101-478d-9091-a3ddb56f9307</entry>
Aug 27 03:54:41 user nova-compute[72990]:       <entry name="uuid">1e214476-7101-478d-9091-a3ddb56f9307</entry>
Aug 27 03:54:41 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:54:41 user nova-compute[72990]:     </system>
Aug 27 03:54:41 user nova-compute[72990]:   </sysinfo>
Aug 27 03:54:41 user nova-compute[72990]:   <os>
Aug 27 03:54:41 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:54:41 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:54:41 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:54:41 user nova-compute[72990]:   </os>
Aug 27 03:54:41 user nova-compute[72990]:   <features>
Aug 27 03:54:41 user nova-compute[72990]:     <acpi/>
Aug 27 03:54:41 user nova-compute[72990]:     <apic/>
Aug 27 03:54:41 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:54:41 user nova-compute[72990]:   </features>
Aug 27 03:54:41 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:54:41 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:54:41 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:54:41 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:54:41 user nova-compute[72990]:   </clock>
Aug 27 03:54:41 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:54:41 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:54:41 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:54:41 user nova-compute[72990]:   </cpu>
Aug 27 03:54:41 user nova-compute[72990]:   <devices>
Aug 27 03:54:41 user nova-compute[72990]:     <disk type="file" device="cdrom">
Aug 27 03:54:41 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 03:54:41 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/1e214476-7101-478d-9091-a3ddb56f9307/disk.config"/>
Aug 27 03:54:41 user nova-compute[72990]:       <target dev="hda" bus="ide"/>
Aug 27 03:54:41 user nova-compute[72990]:     </disk>
Aug 27 03:54:41 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:54:41 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:54:41 user nova-compute[72990]:       <source dev="/dev/sdc"/>
Aug 27 03:54:41 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:54:41 user nova-compute[72990]:       <serial>fe96fc7b-e462-48e7-9786-853341ffcac8</serial>
Aug 27 03:54:41 user nova-compute[72990]:     </disk>
Aug 27 03:54:41 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:54:41 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:54:41 user nova-compute[72990]:       <source dev="/dev/sdd"/>
Aug 27 03:54:41 user nova-compute[72990]:       <target dev="vdb" bus="virtio"/>
Aug 27 03:54:41 user nova-compute[72990]:       <serial>07aa8dc4-38b8-4b06-b244-c161b498550c</serial>
Aug 27 03:54:41 user nova-compute[72990]:     </disk>
Aug 27 03:54:41 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:54:41 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:54:41 user nova-compute[72990]:       <source dev="/dev/sde"/>
Aug 27 03:54:41 user nova-compute[72990]:       <target dev="vdc" bus="virtio"/>
Aug 27 03:54:41 user nova-compute[72990]:       <serial>d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2</serial>
Aug 27 03:54:41 user nova-compute[72990]:     </disk>
Aug 27 03:54:41 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:54:41 user nova-compute[72990]:       <mac address="fa:16:3e:37:24:90"/>
Aug 27 03:54:41 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:54:41 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:54:41 user nova-compute[72990]:       <target dev="tap0c20a87d-20"/>
Aug 27 03:54:41 user nova-compute[72990]:     </interface>
Aug 27 03:54:41 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:54:41 user nova-compute[72990]:       <mac address="fa:16:3e:23:49:28"/>
Aug 27 03:54:41 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:54:41 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:54:41 user nova-compute[72990]:       <target dev="tap91208a0e-6d"/>
Aug 27 03:54:41 user nova-compute[72990]:     </interface>
Aug 27 03:54:41 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:54:41 user nova-compute[72990]:       <mac address="fa:16:3e:ba:e5:0d"/>
Aug 27 03:54:41 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:54:41 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:54:41 user nova-compute[72990]:       <target dev="tap33321514-f4"/>
Aug 27 03:54:41 user nova-compute[72990]:     </interface>
Aug 27 03:54:41 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:54:41 user nova-compute[72990]:       <mac address="fa:16:3e:a4:6a:86"/>
Aug 27 03:54:41 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:54:41 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:54:41 user nova-compute[72990]:       <target dev="tap5f1bea33-f8"/>
Aug 27 03:54:41 user nova-compute[72990]:     </interface>
Aug 27 03:54:41 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:54:41 user nova-compute[72990]:       <mac address="fa:16:3e:2b:c9:8c"/>
Aug 27 03:54:41 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:54:41 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:54:41 user nova-compute[72990]:       <target dev="tap673498bd-0a"/>
Aug 27 03:54:41 user nova-compute[72990]:     </interface>
Aug 27 03:54:41 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:54:41 user nova-compute[72990]:       <mac address="fa:16:3e:25:d8:00"/>
Aug 27 03:54:41 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:54:41 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:54:41 user nova-compute[72990]:       <target dev="taped12bcc2-2d"/>
Aug 27 03:54:41 user nova-compute[72990]:     </interface>
Aug 27 03:54:41 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:54:41 user nova-compute[72990]:       <mac address="fa:16:3e:da:04:f7"/>
Aug 27 03:54:41 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:54:41 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:54:41 user nova-compute[72990]:       <target dev="tap98474278-76"/>
Aug 27 03:54:41 user nova-compute[72990]:     </interface>
Aug 27 03:54:41 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:54:41 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/1e214476-7101-478d-9091-a3ddb56f9307/console.log" append="off"/>
Aug 27 03:54:41 user nova-compute[72990]:     </serial>
Aug 27 03:54:41 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:54:41 user nova-compute[72990]:     <video>
Aug 27 03:54:41 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:54:41 user nova-compute[72990]:     </video>
Aug 27 03:54:41 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:54:41 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:54:41 user nova-compute[72990]:     </rng>
Aug 27 03:54:41 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:54:41 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:54:41 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:54:41 user nova-compute[72990]:     </memballoon>
Aug 27 03:54:41 user nova-compute[72990]:   </devices>
Aug 27 03:54:41 user nova-compute[72990]: </domain>
Aug 27 03:54:41 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:24:90,bridge_name='br-int',has_traffic_filtering=True,id=0c20a87d-20ab-48b0-925a-34cc951b54ba,network=Network(489e7ccb-0047-439d-b180-be939ef4c11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c20a87d-20') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:24:90,bridge_name='br-int',has_traffic_filtering=True,id=0c20a87d-20ab-48b0-925a-34cc951b54ba,network=Network(489e7ccb-0047-439d-b180-be939ef4c11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c20a87d-20') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c20a87d-20, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c20a87d-20, col_values=(('external_ids', {'iface-id': '0c20a87d-20ab-48b0-925a-34cc951b54ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:24:90', 'vm-uuid': '1e214476-7101-478d-9091-a3ddb56f9307'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[16286942-e4c8-49fc-b454-4e4f5689f835]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363] added
Aug 27 03:54:41 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: INFO os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:24:90,bridge_name='br-int',has_traffic_filtering=True,id=0c20a87d-20ab-48b0-925a-34cc951b54ba,network=Network(489e7ccb-0047-439d-b180-be939ef4c11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c20a87d-20')
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:49:28,bridge_name='br-int',has_traffic_filtering=True,id=91208a0e-6d0b-4af4-9996-a282702c92af,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91208a0e-6d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:49:28,bridge_name='br-int',has_traffic_filtering=True,id=91208a0e-6d0b-4af4-9996-a282702c92af,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91208a0e-6d') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91208a0e-6d, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91208a0e-6d, col_values=(('external_ids', {'iface-id': '91208a0e-6d0b-4af4-9996-a282702c92af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:49:28', 'vm-uuid': '1e214476-7101-478d-9091-a3ddb56f9307'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e85eb10-744a-4ec7-ba4e-221a898464e4]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: INFO os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:49:28,bridge_name='br-int',has_traffic_filtering=True,id=91208a0e-6d0b-4af4-9996-a282702c92af,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91208a0e-6d')
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e5:0d,bridge_name='br-int',has_traffic_filtering=True,id=33321514-f420-4c28-b775-13ef897aa0ef,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33321514-f4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e5:0d,bridge_name='br-int',has_traffic_filtering=True,id=33321514-f420-4c28-b775-13ef897aa0ef,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33321514-f4') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33321514-f4, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33321514-f4, col_values=(('external_ids', {'iface-id': '33321514-f420-4c28-b775-13ef897aa0ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:e5:0d', 'vm-uuid': '1e214476-7101-478d-9091-a3ddb56f9307'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[256605f8-6079-4415-9c8d-5b7fef866f3a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YcdBbxJv {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YcdBbxJv" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[35168bea-72f7-4e53-9cfc-5fdfcf3fd8a4]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YcdBbxJv'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: INFO os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e5:0d,bridge_name='br-int',has_traffic_filtering=True,id=33321514-f420-4c28-b775-13ef897aa0ef,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33321514-f4')
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6a:86,bridge_name='br-int',has_traffic_filtering=True,id=5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1bea33-f8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6a:86,bridge_name='br-int',has_traffic_filtering=True,id=5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1bea33-f8') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f1bea33-f8, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f1bea33-f8, col_values=(('external_ids', {'iface-id': '5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:6a:86', 'vm-uuid': '1e214476-7101-478d-9091-a3ddb56f9307'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[506dd6f1-0763-4593-8c40-b61dad0581e1]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: INFO os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6a:86,bridge_name='br-int',has_traffic_filtering=True,id=5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1bea33-f8')
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "673498bd-0a4d-499d-8aaf-1bd148132f98", "address": "fa:16:3e:2b:c9:8c", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673498bd-0a", "ovs_interfaceid": "673498bd-0a4d-499d-8aaf-1bd148132f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "673498bd-0a4d-499d-8aaf-1bd148132f98", "address": "fa:16:3e:2b:c9:8c", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673498bd-0a", "ovs_interfaceid": "673498bd-0a4d-499d-8aaf-1bd148132f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c9:8c,bridge_name='br-int',has_traffic_filtering=True,id=673498bd-0a4d-499d-8aaf-1bd148132f98,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673498bd-0a') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c9:8c,bridge_name='br-int',has_traffic_filtering=True,id=673498bd-0a4d-499d-8aaf-1bd148132f98,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673498bd-0a') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f92592-b21f-43fd-ae18-2620d166c284]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap673498bd-0a, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap673498bd-0a, col_values=(('external_ids', {'iface-id': '673498bd-0a4d-499d-8aaf-1bd148132f98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:c9:8c', 'vm-uuid': '1e214476-7101-478d-9091-a3ddb56f9307'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:42 user nova-compute[72990]: INFO os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c9:8c,bridge_name='br-int',has_traffic_filtering=True,id=673498bd-0a4d-499d-8aaf-1bd148132f98,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673498bd-0a')
Aug 27 03:54:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=ed12bcc2-2daf-47c0-8571-ac118426948c,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped12bcc2-2d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=ed12bcc2-2daf-47c0-8571-ac118426948c,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped12bcc2-2d') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped12bcc2-2d, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped12bcc2-2d, col_values=(('external_ids', {'iface-id': 'ed12bcc2-2daf-47c0-8571-ac118426948c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:d8:00', 'vm-uuid': '1e214476-7101-478d-9091-a3ddb56f9307'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ed09d9-6498-482d-b0f6-495842ce41e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260]
Aug 27 03:54:42 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260] successful.
Aug 27 03:54:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7e8f4e-c146-458c-b6ce-9753ff0843eb]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:42 user nova-compute[72990]: INFO os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=ed12bcc2-2daf-47c0-8571-ac118426948c,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped12bcc2-2d')
Aug 27 03:54:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:f7,bridge_name='br-int',has_traffic_filtering=True,id=98474278-76fb-4c4a-933c-9cde3c86f3d5,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98474278-76') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:f7,bridge_name='br-int',has_traffic_filtering=True,id=98474278-76fb-4c4a-933c-9cde3c86f3d5,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98474278-76') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98474278-76, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98474278-76, col_values=(('external_ids', {'iface-id': '98474278-76fb-4c4a-933c-9cde3c86f3d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:04:f7', 'vm-uuid': '1e214476-7101-478d-9091-a3ddb56f9307'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[450ae69f-9c34-4a10-9f8e-7df58aa7e336]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:54:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] HCTL ('40', '-', '-', 0) found on session 36 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9ba52f-0137-4312-9e06-90e49cb61efb]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Searching for a device in session 36 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcdBbxJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:42 user nova-compute[72990]: INFO os_vif [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:f7,bridge_name='br-int',has_traffic_filtering=True,id=98474278-76fb-4c4a-933c-9cde3c86f3d5,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98474278-76')
Aug 27 03:54:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] No BDM found with device name hda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] No VIF found with MAC fa:16:3e:37:24:90, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] No VIF found with MAC fa:16:3e:2b:c9:8c, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:54:42 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Using config drive
Aug 27 03:54:42 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108467.3484023, a0800495-d65a-4cdc-95d7-b0e0d07e3e5d => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:54:42 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] VM Stopped (Lifecycle Event)
Aug 27 03:54:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-1178bd0f-d323-4914-8819-33a54a9bc583 None None] [instance: a0800495-d65a-4cdc-95d7-b0e0d07e3e5d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:54:42 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Creating config drive at /opt/stack/data/nova/instances/1e214476-7101-478d-9091-a3ddb56f9307/disk.config
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1e214476-7101-478d-9091-a3ddb56f9307/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp502horby {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1e214476-7101-478d-9091-a3ddb56f9307/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp502horby" returned: 0 in 0.054s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== connect_volume: return (2647ms) {'type': 'block', 'scsi_wwn': '26564613130383730', 'path': '/dev/sdi'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564613130383730', 'path': '/dev/sdi'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1658965801',display_name='tempest-ServerActionsTestOtherA-server-1658965801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1658965801',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx4YMOpiFApd+UuDRSLGi+Pmb0zohcJr1O+wFKm9ZeByZUcToOSr5LVAydvhFQAlBpKXomrxo0iOLbfaHvfjryxwDtlu2Xqz9AegDptkwou3u7ClkNhexzzpMlOVgjY6Q==',key_name='tempest-keypair-749840506',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-k1hscn8l',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:54:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=d4f94cba-21ec-42a8-babc-859becde2c82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1848835739-network", "vif_mac": "fa:16:3e:fb:cc:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1848835739-network", "vif_mac": "fa:16:3e:fb:cc:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:54:43 user nova-compute[72990]:   <uuid>d4f94cba-21ec-42a8-babc-859becde2c82</uuid>
Aug 27 03:54:43 user nova-compute[72990]:   <name>instance-0000001c</name>
Aug 27 03:54:43 user nova-compute[72990]:   <memory>2097152</memory>
Aug 27 03:54:43 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:54:43 user nova-compute[72990]:   <metadata>
Aug 27 03:54:43 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:54:43 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:54:43 user nova-compute[72990]:       <nova:name>tempest-ServerActionsTestOtherA-server-1658965801</nova:name>
Aug 27 03:54:43 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:54:40</nova:creationTime>
Aug 27 03:54:43 user nova-compute[72990]:       <nova:flavor name="m1.small">
Aug 27 03:54:43 user nova-compute[72990]:         <nova:memory>2048</nova:memory>
Aug 27 03:54:43 user nova-compute[72990]:         <nova:disk>20</nova:disk>
Aug 27 03:54:43 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:54:43 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:54:43 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:54:43 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:54:43 user nova-compute[72990]:       <nova:owner>
Aug 27 03:54:43 user nova-compute[72990]:         <nova:user uuid="cb95e31732904174a8ebddf48c6426ed">tempest-ServerActionsTestOtherA-938526966-project-member</nova:user>
Aug 27 03:54:43 user nova-compute[72990]:         <nova:project uuid="2282ed15ca724f029c368c8a5ce0f268">tempest-ServerActionsTestOtherA-938526966</nova:project>
Aug 27 03:54:43 user nova-compute[72990]:       </nova:owner>
Aug 27 03:54:43 user nova-compute[72990]:       <nova:ports>
Aug 27 03:54:43 user nova-compute[72990]:         <nova:port uuid="a9b2e415-e44f-4302-9a4a-6b079b3b4c29">
Aug 27 03:54:43 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 03:54:43 user nova-compute[72990]:         </nova:port>
Aug 27 03:54:43 user nova-compute[72990]:       </nova:ports>
Aug 27 03:54:43 user nova-compute[72990]:     </nova:instance>
Aug 27 03:54:43 user nova-compute[72990]:   </metadata>
Aug 27 03:54:43 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:54:43 user nova-compute[72990]:     <system>
Aug 27 03:54:43 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:54:43 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:54:43 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:54:43 user nova-compute[72990]:       <entry name="serial">d4f94cba-21ec-42a8-babc-859becde2c82</entry>
Aug 27 03:54:43 user nova-compute[72990]:       <entry name="uuid">d4f94cba-21ec-42a8-babc-859becde2c82</entry>
Aug 27 03:54:43 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:54:43 user nova-compute[72990]:     </system>
Aug 27 03:54:43 user nova-compute[72990]:   </sysinfo>
Aug 27 03:54:43 user nova-compute[72990]:   <os>
Aug 27 03:54:43 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:54:43 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:54:43 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:54:43 user nova-compute[72990]:   </os>
Aug 27 03:54:43 user nova-compute[72990]:   <features>
Aug 27 03:54:43 user nova-compute[72990]:     <acpi/>
Aug 27 03:54:43 user nova-compute[72990]:     <apic/>
Aug 27 03:54:43 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:54:43 user nova-compute[72990]:   </features>
Aug 27 03:54:43 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:54:43 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:54:43 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:54:43 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:54:43 user nova-compute[72990]:   </clock>
Aug 27 03:54:43 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:54:43 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:54:43 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:54:43 user nova-compute[72990]:   </cpu>
Aug 27 03:54:43 user nova-compute[72990]:   <devices>
Aug 27 03:54:43 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:54:43 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:54:43 user nova-compute[72990]:       <source dev="/dev/sdi"/>
Aug 27 03:54:43 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:54:43 user nova-compute[72990]:       <serial>a9e1e7bb-c0c9-4659-8796-97fded91b363</serial>
Aug 27 03:54:43 user nova-compute[72990]:     </disk>
Aug 27 03:54:43 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:54:43 user nova-compute[72990]:       <mac address="fa:16:3e:fb:cc:38"/>
Aug 27 03:54:43 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:54:43 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:54:43 user nova-compute[72990]:       <target dev="tapa9b2e415-e4"/>
Aug 27 03:54:43 user nova-compute[72990]:     </interface>
Aug 27 03:54:43 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:54:43 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/d4f94cba-21ec-42a8-babc-859becde2c82/console.log" append="off"/>
Aug 27 03:54:43 user nova-compute[72990]:     </serial>
Aug 27 03:54:43 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:54:43 user nova-compute[72990]:     <video>
Aug 27 03:54:43 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:54:43 user nova-compute[72990]:     </video>
Aug 27 03:54:43 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:54:43 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:54:43 user nova-compute[72990]:     </rng>
Aug 27 03:54:43 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:54:43 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:54:43 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:54:43 user nova-compute[72990]:     </memballoon>
Aug 27 03:54:43 user nova-compute[72990]:   </devices>
Aug 27 03:54:43 user nova-compute[72990]: </domain>
Aug 27 03:54:43 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1658965801',display_name='tempest-ServerActionsTestOtherA-server-1658965801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1658965801',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx4YMOpiFApd+UuDRSLGi+Pmb0zohcJr1O+wFKm9ZeByZUcToOSr5LVAydvhFQAlBpKXomrxo0iOLbfaHvfjryxwDtlu2Xqz9AegDptkwou3u7ClkNhexzzpMlOVgjY6Q==',key_name='tempest-keypair-749840506',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-k1hscn8l',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:54:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=d4f94cba-21ec-42a8-babc-859becde2c82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1848835739-network", "vif_mac": "fa:16:3e:fb:cc:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1848835739-network", "vif_mac": "fa:16:3e:fb:cc:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG os_vif [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9b2e415-e4, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9b2e415-e4, col_values=(('external_ids', {'iface-id': 'a9b2e415-e44f-4302-9a4a-6b079b3b4c29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:cc:38', 'vm-uuid': 'd4f94cba-21ec-42a8-babc-859becde2c82'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:43 user nova-compute[72990]: INFO os_vif [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4')
Aug 27 03:54:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:54:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] No VIF found with MAC fa:16:3e:fb:cc:38, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-925c05b7-0b8e-4973-a043-81c63a5998a7 req-761de9ab-b394-40c1-a0d7-a39e8bd7893e service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-925c05b7-0b8e-4973-a043-81c63a5998a7 req-761de9ab-b394-40c1-a0d7-a39e8bd7893e service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-925c05b7-0b8e-4973-a043-81c63a5998a7 req-761de9ab-b394-40c1-a0d7-a39e8bd7893e service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-925c05b7-0b8e-4973-a043-81c63a5998a7 req-761de9ab-b394-40c1-a0d7-a39e8bd7893e service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-925c05b7-0b8e-4973-a043-81c63a5998a7 req-761de9ab-b394-40c1-a0d7-a39e8bd7893e service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:44 user nova-compute[72990]: WARNING nova.compute.manager [req-925c05b7-0b8e-4973-a043-81c63a5998a7 req-761de9ab-b394-40c1-a0d7-a39e8bd7893e service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-0c20a87d-20ab-48b0-925a-34cc951b54ba for instance with vm_state building and task_state spawning.
Aug 27 03:54:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-ff291300-62f8-4bf3-8186-bc07bd7f8abe req-3291f143-1d3b-475c-81b0-831bcd28dac6 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-91208a0e-6d0b-4af4-9996-a282702c92af {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ff291300-62f8-4bf3-8186-bc07bd7f8abe req-3291f143-1d3b-475c-81b0-831bcd28dac6 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ff291300-62f8-4bf3-8186-bc07bd7f8abe req-3291f143-1d3b-475c-81b0-831bcd28dac6 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ff291300-62f8-4bf3-8186-bc07bd7f8abe req-3291f143-1d3b-475c-81b0-831bcd28dac6 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-ff291300-62f8-4bf3-8186-bc07bd7f8abe req-3291f143-1d3b-475c-81b0-831bcd28dac6 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-91208a0e-6d0b-4af4-9996-a282702c92af {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:45 user nova-compute[72990]: WARNING nova.compute.manager [req-ff291300-62f8-4bf3-8186-bc07bd7f8abe req-3291f143-1d3b-475c-81b0-831bcd28dac6 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-91208a0e-6d0b-4af4-9996-a282702c92af for instance with vm_state building and task_state spawning.
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108470.9306314, 338682cb-8c70-49c3-b88c-362e96ec8fb1 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:54:45 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] VM Stopped (Lifecycle Event)
Aug 27 03:54:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8575cace-3be6-4493-83c0-f1696276f1e8 None None] [instance: 338682cb-8c70-49c3-b88c-362e96ec8fb1] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-957a7482-50c4-4ca0-a4ed-20b039cbad85 req-2e4791b9-29b0-4848-864b-4ae06ffd708c service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received event network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-957a7482-50c4-4ca0-a4ed-20b039cbad85 req-2e4791b9-29b0-4848-864b-4ae06ffd708c service nova] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-957a7482-50c4-4ca0-a4ed-20b039cbad85 req-2e4791b9-29b0-4848-864b-4ae06ffd708c service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-957a7482-50c4-4ca0-a4ed-20b039cbad85 req-2e4791b9-29b0-4848-864b-4ae06ffd708c service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-957a7482-50c4-4ca0-a4ed-20b039cbad85 req-2e4791b9-29b0-4848-864b-4ae06ffd708c service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] No waiting events found dispatching network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:46 user nova-compute[72990]: WARNING nova.compute.manager [req-957a7482-50c4-4ca0-a4ed-20b039cbad85 req-2e4791b9-29b0-4848-864b-4ae06ffd708c service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received unexpected event network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 for instance with vm_state active and task_state resize_finish.
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:46 user nova-compute[72990]: WARNING nova.compute.manager [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-0c20a87d-20ab-48b0-925a-34cc951b54ba for instance with vm_state building and task_state spawning.
Aug 27 03:54:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-33321514-f420-4c28-b775-13ef897aa0ef {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-33321514-f420-4c28-b775-13ef897aa0ef {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:46 user nova-compute[72990]: WARNING nova.compute.manager [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-33321514-f420-4c28-b775-13ef897aa0ef for instance with vm_state building and task_state spawning.
Aug 27 03:54:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-33321514-f420-4c28-b775-13ef897aa0ef {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-33321514-f420-4c28-b775-13ef897aa0ef {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:46 user nova-compute[72990]: WARNING nova.compute.manager [req-13048d82-0342-4a6b-977e-ee35f6b74740 req-7eea2fa6-1487-41f9-b39f-9407e7b4a8ef service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-33321514-f420-4c28-b775-13ef897aa0ef for instance with vm_state building and task_state spawning.
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-91208a0e-6d0b-4af4-9996-a282702c92af {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-91208a0e-6d0b-4af4-9996-a282702c92af {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:47 user nova-compute[72990]: WARNING nova.compute.manager [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-91208a0e-6d0b-4af4-9996-a282702c92af for instance with vm_state building and task_state spawning.
Aug 27 03:54:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:47 user nova-compute[72990]: WARNING nova.compute.manager [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-673498bd-0a4d-499d-8aaf-1bd148132f98 for instance with vm_state building and task_state spawning.
Aug 27 03:54:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:47 user nova-compute[72990]: WARNING nova.compute.manager [req-c503cd81-a32f-46f0-a3f7-d0e5c839d669 req-b84eaaf4-eab0-4265-b708-1ed7dfdcff77 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-673498bd-0a4d-499d-8aaf-1bd148132f98 for instance with vm_state building and task_state spawning.
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received event network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] No waiting events found dispatching network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:48 user nova-compute[72990]: WARNING nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received unexpected event network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 for instance with vm_state active and task_state resize_finish.
Aug 27 03:54:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:48 user nova-compute[72990]: WARNING nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c for instance with vm_state building and task_state spawning.
Aug 27 03:54:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:48 user nova-compute[72990]: WARNING nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c for instance with vm_state building and task_state spawning.
Aug 27 03:54:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:48 user nova-compute[72990]: WARNING nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-98474278-76fb-4c4a-933c-9cde3c86f3d5 for instance with vm_state building and task_state spawning.
Aug 27 03:54:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:48 user nova-compute[72990]: WARNING nova.compute.manager [req-b7754dbf-19b7-4529-bc71-2695dbdcaee9 req-91ce9917-51d6-4254-80e8-42a1dadc495a service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-98474278-76fb-4c4a-933c-9cde3c86f3d5 for instance with vm_state building and task_state spawning.
Aug 27 03:54:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108489.119616, d4f94cba-21ec-42a8-babc-859becde2c82 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:54:49 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] VM Resumed (Lifecycle Event)
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:54:49 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Instance running successfully.
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Failed to set time: agent not configured {{(pid=72990) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7bde2c2d-69d4-4681-99e8-f396989e5b4d tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] finish_migration finished successfully. {{(pid=72990) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:54:49 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108489.121011, d4f94cba-21ec-42a8-babc-859becde2c82 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:54:49 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] VM Started (Lifecycle Event)
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:54:49 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1d8b955-f247-40d8-b7ae-c74b1a292fd4 req-67789f77-5ee8-4482-9220-0dd4e2d5f7f2 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1d8b955-f247-40d8-b7ae-c74b1a292fd4 req-67789f77-5ee8-4482-9220-0dd4e2d5f7f2 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1d8b955-f247-40d8-b7ae-c74b1a292fd4 req-67789f77-5ee8-4482-9220-0dd4e2d5f7f2 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1d8b955-f247-40d8-b7ae-c74b1a292fd4 req-67789f77-5ee8-4482-9220-0dd4e2d5f7f2 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1d8b955-f247-40d8-b7ae-c74b1a292fd4 req-67789f77-5ee8-4482-9220-0dd4e2d5f7f2 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:49 user nova-compute[72990]: WARNING nova.compute.manager [req-f1d8b955-f247-40d8-b7ae-c74b1a292fd4 req-67789f77-5ee8-4482-9220-0dd4e2d5f7f2 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-ed12bcc2-2daf-47c0-8571-ac118426948c for instance with vm_state building and task_state spawning.
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1d8b955-f247-40d8-b7ae-c74b1a292fd4 req-67789f77-5ee8-4482-9220-0dd4e2d5f7f2 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1d8b955-f247-40d8-b7ae-c74b1a292fd4 req-67789f77-5ee8-4482-9220-0dd4e2d5f7f2 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1d8b955-f247-40d8-b7ae-c74b1a292fd4 req-67789f77-5ee8-4482-9220-0dd4e2d5f7f2 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1d8b955-f247-40d8-b7ae-c74b1a292fd4 req-67789f77-5ee8-4482-9220-0dd4e2d5f7f2 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1d8b955-f247-40d8-b7ae-c74b1a292fd4 req-67789f77-5ee8-4482-9220-0dd4e2d5f7f2 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:54:49 user nova-compute[72990]: WARNING nova.compute.manager [req-f1d8b955-f247-40d8-b7ae-c74b1a292fd4 req-67789f77-5ee8-4482-9220-0dd4e2d5f7f2 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-ed12bcc2-2daf-47c0-8571-ac118426948c for instance with vm_state building and task_state spawning.
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108489.6864448, 1e214476-7101-478d-9091-a3ddb56f9307 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:54:49 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] VM Resumed (Lifecycle Event)
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:54:49 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Instance spawned successfully.
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:54:49 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108489.6869912, 1e214476-7101-478d-9091-a3ddb56f9307 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:54:49 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] VM Started (Lifecycle Event)
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:54:49 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:54:49 user nova-compute[72990]: INFO nova.compute.manager [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Took 12.24 seconds to spawn the instance on the hypervisor.
Aug 27 03:54:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:54:49 user nova-compute[72990]: INFO nova.compute.manager [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Took 55.01 seconds to build instance.
Aug 27 03:54:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-95b7caba-b36d-4399-9498-326546f59380 tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "1e214476-7101-478d-9091-a3ddb56f9307" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 55.119s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-3711f725-67b1-4b4a-ac7e-6ad00554fb58 req-a739468e-0cde-4b05-9128-ba072c1e26c1 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-changed-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-3711f725-67b1-4b4a-ac7e-6ad00554fb58 req-a739468e-0cde-4b05-9128-ba072c1e26c1 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Refreshing instance network info cache due to event network-changed-1344eed9-36fe-4fce-a572-94a310f2d618. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:54:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3711f725-67b1-4b4a-ac7e-6ad00554fb58 req-a739468e-0cde-4b05-9128-ba072c1e26c1 service nova] Acquiring lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3711f725-67b1-4b4a-ac7e-6ad00554fb58 req-a739468e-0cde-4b05-9128-ba072c1e26c1 service nova] Acquired lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:54 user nova-compute[72990]: DEBUG nova.network.neutron [req-3711f725-67b1-4b4a-ac7e-6ad00554fb58 req-a739468e-0cde-4b05-9128-ba072c1e26c1 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Refreshing network info cache for port 1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:54:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:54:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "15a88698-88d1-4c6b-9e40-98b618978a33" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:54:54 user nova-compute[72990]: INFO nova.compute.manager [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Detaching volume a40d71b0-dac1-41f5-af3d-df8a97ff5128
Aug 27 03:54:55 user nova-compute[72990]: INFO nova.virt.block_device [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Attempting to driver detach volume a40d71b0-dac1-41f5-af3d-df8a97ff5128 from mountpoint /dev/vdb
Aug 27 03:54:55 user nova-compute[72990]: DEBUG nova.network.neutron [req-3711f725-67b1-4b4a-ac7e-6ad00554fb58 req-a739468e-0cde-4b05-9128-ba072c1e26c1 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updated VIF entry in instance network info cache for port 1344eed9-36fe-4fce-a572-94a310f2d618. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG nova.network.neutron [req-3711f725-67b1-4b4a-ac7e-6ad00554fb58 req-a739468e-0cde-4b05-9128-ba072c1e26c1 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updating instance_info_cache with network_info: [{"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Attempting to detach device vdb from instance 15a88698-88d1-4c6b-9e40-98b618978a33 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:54:55 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:54:55 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:54:55 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:54:55 user nova-compute[72990]:   <serial>a40d71b0-dac1-41f5-af3d-df8a97ff5128</serial>
Aug 27 03:54:55 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:54:55 user nova-compute[72990]: </disk>
Aug 27 03:54:55 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3711f725-67b1-4b4a-ac7e-6ad00554fb58 req-a739468e-0cde-4b05-9128-ba072c1e26c1 service nova] Releasing lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:55 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Successfully detached device vdb from instance 15a88698-88d1-4c6b-9e40-98b618978a33 from the persistent domain config.
Aug 27 03:54:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15a88698-88d1-4c6b-9e40-98b618978a33 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 03:54:55 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:54:55 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:54:55 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:54:55 user nova-compute[72990]:   <serial>a40d71b0-dac1-41f5-af3d-df8a97ff5128</serial>
Aug 27 03:54:55 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 03:54:55 user nova-compute[72990]: </disk>
Aug 27 03:54:55 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693108495.5571756, 15a88698-88d1-4c6b-9e40-98b618978a33 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 03:54:55 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Successfully detached device vdb from instance 15a88698-88d1-4c6b-9e40-98b618978a33 from the live domain config.
Aug 27 03:54:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZCohYIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:54:55 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1096ce-57ae-401c-9aca-908bc18f86ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6e5e51-c253-4edb-a45d-3aac5c22d961]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:54:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:54:55 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:54:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7143cb7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c0d5c3-1415-4b65-b5c5-6f9c8c8fd212]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f9f407-d8fe-426e-8f09-21c2896982c1]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40220dd-9ba2-477f-9874-e87cfab589ee]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a58b18b-3d74-4a67-ac87-1d14e9134dc9]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bdc4fc-9ce0-4ef3-b0f6-6cf7955b29d0]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4934473a-ee27-43fb-8d90-ccf880b1b2f9]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128, portal: 172.16.0.220,3260]
Aug 27 03:54:55 user nova-compute[72990]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128, portal: 172.16.0.220,3260] successful.
Aug 27 03:54:55 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a40d71b0-dac1-41f5-af3d-df8a97ff5128 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[695669ab-5b71-4714-a075-7766ac8a06ec]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] <== disconnect_volume: return (343ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:54:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:54:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-63f99ec1-a9be-43e4-b33d-4ff94fdd5417 req-f3ce4be6-937c-4678-b660-1b70a60b11f9 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-changed-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:54:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-63f99ec1-a9be-43e4-b33d-4ff94fdd5417 req-f3ce4be6-937c-4678-b660-1b70a60b11f9 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Refreshing instance network info cache due to event network-changed-1344eed9-36fe-4fce-a572-94a310f2d618. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:54:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63f99ec1-a9be-43e4-b33d-4ff94fdd5417 req-f3ce4be6-937c-4678-b660-1b70a60b11f9 service nova] Acquiring lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:54:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63f99ec1-a9be-43e4-b33d-4ff94fdd5417 req-f3ce4be6-937c-4678-b660-1b70a60b11f9 service nova] Acquired lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:54:56 user nova-compute[72990]: DEBUG nova.network.neutron [req-63f99ec1-a9be-43e4-b33d-4ff94fdd5417 req-f3ce4be6-937c-4678-b660-1b70a60b11f9 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Refreshing network info cache for port 1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:54:56 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'flavor' on Instance uuid 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:54:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9ebd9802-864e-4541-a371-acf3c8658b92 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "15a88698-88d1-4c6b-9e40-98b618978a33" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.900s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:54:56 user nova-compute[72990]: DEBUG nova.network.neutron [req-63f99ec1-a9be-43e4-b33d-4ff94fdd5417 req-f3ce4be6-937c-4678-b660-1b70a60b11f9 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updated VIF entry in instance network info cache for port 1344eed9-36fe-4fce-a572-94a310f2d618. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:54:56 user nova-compute[72990]: DEBUG nova.network.neutron [req-63f99ec1-a9be-43e4-b33d-4ff94fdd5417 req-f3ce4be6-937c-4678-b660-1b70a60b11f9 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updating instance_info_cache with network_info: [{"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:54:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-63f99ec1-a9be-43e4-b33d-4ff94fdd5417 req-f3ce4be6-937c-4678-b660-1b70a60b11f9 service nova] Releasing lock "refresh_cache-15a88698-88d1-4c6b-9e40-98b618978a33" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:54:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:54:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:55:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:55:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 03:55:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:55:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 03:55:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:29 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:55:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:55:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:55:32 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:55:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:55:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:55:33 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:55:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:55:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:55:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:55:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:55:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "aa475371-4888-4c4b-9b74-4e813b804da6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:35 user nova-compute[72990]: INFO nova.compute.manager [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Unshelving
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:35 user nova-compute[72990]: INFO nova.virt.block_device [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Booting with volume c9c9a333-ea9b-467b-9f8d-8579cc71b083 at /dev/vda
Aug 27 03:55:35 user nova-compute[72990]: DEBUG os_brick.utils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[14393b7c-7e32-4751-be93-8c75a911ee04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b77575-2fa5-4c2e-ba24-114a98fc0a94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[904ac558-d472-4fbc-979c-7fbab22017ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f320f4e-64e0-4d29-80f6-2aeeafd318b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:55:35 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6935e96-72ff-43ab-a8e2-f3d11dc08e60]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG os_brick.utils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updating existing volume attachment record: caaf4a90-3971-489f-8536-575a8ff322d0 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:55:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:55:38 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:55:38 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:55:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7290MB free_disk=24.972122192382812GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:55:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:38 user nova-compute[72990]: INFO nova.compute.manager [None req-62152ee5-77df-4ec2-89d3-87d25def8dd6 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Unrescuing
Aug 27 03:55:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-62152ee5-77df-4ec2-89d3-87d25def8dd6 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "refresh_cache-250288e9-5421-4757-9258-fa1cf0c3be2f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:55:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-62152ee5-77df-4ec2-89d3-87d25def8dd6 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquired lock "refresh_cache-250288e9-5421-4757-9258-fa1cf0c3be2f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:55:38 user nova-compute[72990]: DEBUG nova.network.neutron [None req-62152ee5-77df-4ec2-89d3-87d25def8dd6 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Applying migration context for instance d4f94cba-21ec-42a8-babc-859becde2c82 as it has an incoming, in-progress migration 12409cc1-101b-4d76-bc54-53f0a795232c. Migration status is finished {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 03:55:39 user nova-compute[72990]: INFO nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updating resource usage from migration 12409cc1-101b-4d76-bc54-53f0a795232c
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 6a44010b-9a96-4343-a35c-1f212d21e47b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 15a88698-88d1-4c6b-9e40-98b618978a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 250288e9-5421-4757-9258-fa1cf0c3be2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 1e214476-7101-478d-9091-a3ddb56f9307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Migration 12409cc1-101b-4d76-bc54-53f0a795232c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance d4f94cba-21ec-42a8-babc-859becde2c82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aa475371-4888-4c4b-9b74-4e813b804da6 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.658s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-62152ee5-77df-4ec2-89d3-87d25def8dd6 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Updating instance_info_cache with network_info: [{"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-62152ee5-77df-4ec2-89d3-87d25def8dd6 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Releasing lock "refresh_cache-250288e9-5421-4757-9258-fa1cf0c3be2f" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG nova.objects.instance [None req-62152ee5-77df-4ec2-89d3-87d25def8dd6 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'flavor' on Instance uuid 250288e9-5421-4757-9258-fa1cf0c3be2f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-19a3a0be-3575-4f85-b028-6257705b6e51 req-a074b2fe-ba1b-4a31-a381-cce116d39f88 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-unplugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:55:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-19a3a0be-3575-4f85-b028-6257705b6e51 req-a074b2fe-ba1b-4a31-a381-cce116d39f88 service nova] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-19a3a0be-3575-4f85-b028-6257705b6e51 req-a074b2fe-ba1b-4a31-a381-cce116d39f88 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-19a3a0be-3575-4f85-b028-6257705b6e51 req-a074b2fe-ba1b-4a31-a381-cce116d39f88 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-19a3a0be-3575-4f85-b028-6257705b6e51 req-a074b2fe-ba1b-4a31-a381-cce116d39f88 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] No waiting events found dispatching network-vif-unplugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:55:40 user nova-compute[72990]: WARNING nova.compute.manager [req-19a3a0be-3575-4f85-b028-6257705b6e51 req-a074b2fe-ba1b-4a31-a381-cce116d39f88 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received unexpected event network-vif-unplugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:55:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Instance destroyed successfully.
Aug 27 03:55:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:55:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:55:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 03:55:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:55:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:55:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:55:41 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Updating instance_info_cache with network_info: [{"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-ca203604-996d-4558-9857-df9e2001c319" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-ff587289-0f67-42ac-8be6-06f66b1cf02e req-dfa2adfe-5ee8-4e81-9778-74e559fe8028 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ff587289-0f67-42ac-8be6-06f66b1cf02e req-dfa2adfe-5ee8-4e81-9778-74e559fe8028 service nova] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ff587289-0f67-42ac-8be6-06f66b1cf02e req-dfa2adfe-5ee8-4e81-9778-74e559fe8028 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ff587289-0f67-42ac-8be6-06f66b1cf02e req-dfa2adfe-5ee8-4e81-9778-74e559fe8028 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-ff587289-0f67-42ac-8be6-06f66b1cf02e req-dfa2adfe-5ee8-4e81-9778-74e559fe8028 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] No waiting events found dispatching network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:55:42 user nova-compute[72990]: WARNING nova.compute.manager [req-ff587289-0f67-42ac-8be6-06f66b1cf02e req-dfa2adfe-5ee8-4e81-9778-74e559fe8028 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received unexpected event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:55:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-c2655672-8832-41c9-949b-a0c66d72f3c6 req-25d83017-fae6-408d-9960-12ae1e21daaa service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c2655672-8832-41c9-949b-a0c66d72f3c6 req-25d83017-fae6-408d-9960-12ae1e21daaa service nova] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c2655672-8832-41c9-949b-a0c66d72f3c6 req-25d83017-fae6-408d-9960-12ae1e21daaa service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c2655672-8832-41c9-949b-a0c66d72f3c6 req-25d83017-fae6-408d-9960-12ae1e21daaa service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-c2655672-8832-41c9-949b-a0c66d72f3c6 req-25d83017-fae6-408d-9960-12ae1e21daaa service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] No waiting events found dispatching network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:55:44 user nova-compute[72990]: WARNING nova.compute.manager [req-c2655672-8832-41c9-949b-a0c66d72f3c6 req-25d83017-fae6-408d-9960-12ae1e21daaa service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received unexpected event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:55:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-c2655672-8832-41c9-949b-a0c66d72f3c6 req-25d83017-fae6-408d-9960-12ae1e21daaa service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c2655672-8832-41c9-949b-a0c66d72f3c6 req-25d83017-fae6-408d-9960-12ae1e21daaa service nova] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c2655672-8832-41c9-949b-a0c66d72f3c6 req-25d83017-fae6-408d-9960-12ae1e21daaa service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c2655672-8832-41c9-949b-a0c66d72f3c6 req-25d83017-fae6-408d-9960-12ae1e21daaa service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-c2655672-8832-41c9-949b-a0c66d72f3c6 req-25d83017-fae6-408d-9960-12ae1e21daaa service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] No waiting events found dispatching network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:55:44 user nova-compute[72990]: WARNING nova.compute.manager [req-c2655672-8832-41c9-949b-a0c66d72f3c6 req-25d83017-fae6-408d-9960-12ae1e21daaa service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received unexpected event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 for instance with vm_state rescued and task_state unrescuing.
Aug 27 03:55:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Removed pending event for 250288e9-5421-4757-9258-fa1cf0c3be2f due to event {{(pid=72990) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108544.3672984, 250288e9-5421-4757-9258-fa1cf0c3be2f => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:55:44 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] VM Resumed (Lifecycle Event)
Aug 27 03:55:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-62152ee5-77df-4ec2-89d3-87d25def8dd6 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:55:44 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 03:55:44 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108544.36897, 250288e9-5421-4757-9258-fa1cf0c3be2f => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:55:44 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] VM Started (Lifecycle Event)
Aug 27 03:55:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:55:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "15a88698-88d1-4c6b-9e40-98b618978a33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:45 user nova-compute[72990]: INFO nova.compute.manager [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Terminating instance
Aug 27 03:55:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-9a642aad-bef3-439e-a17b-a557c2ba6596 req-bb2b4e00-4df4-4d1b-bd52-98c27ffd8973 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-unplugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9a642aad-bef3-439e-a17b-a557c2ba6596 req-bb2b4e00-4df4-4d1b-bd52-98c27ffd8973 service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9a642aad-bef3-439e-a17b-a557c2ba6596 req-bb2b4e00-4df4-4d1b-bd52-98c27ffd8973 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9a642aad-bef3-439e-a17b-a557c2ba6596 req-bb2b4e00-4df4-4d1b-bd52-98c27ffd8973 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-9a642aad-bef3-439e-a17b-a557c2ba6596 req-bb2b4e00-4df4-4d1b-bd52-98c27ffd8973 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-unplugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-9a642aad-bef3-439e-a17b-a557c2ba6596 req-bb2b4e00-4df4-4d1b-bd52-98c27ffd8973 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-unplugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:46 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Instance destroyed successfully.
Aug 27 03:55:46 user nova-compute[72990]: DEBUG nova.objects.instance [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'resources' on Instance uuid 15a88698-88d1-4c6b-9e40-98b618978a33 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:55:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-931752626',display_name='tempest-ServerRescueNegativeTestJSON-server-931752626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-931752626',id=22,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0KVWF1WU6AFtBbBFdWiBdRcaer72AgRt0JV3tBDQqpR+utjPDLU9VGe36YKFhIncVurAQDbGkNQcA/aRjuUqCaWieSIs1x5jzh2ZRbb1KrdmRyCMe/3f0ttjSiAlwhig==',key_name='tempest-keypair-1761284820',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:51:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='567ed48c72c547c6984851d6ba37e780',ramdisk_id='',reservation_id='r-92ss61f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-311406621',owner_user_name='tempest-ServerRescueNegativeTestJSON-311406621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:53:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0631ab8ad8648e2912d4e554fbbe195',uuid=15a88698-88d1-4c6b-9e40-98b618978a33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:55:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converting VIF {"id": "1344eed9-36fe-4fce-a572-94a310f2d618", "address": "fa:16:3e:36:a6:b0", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344eed9-36", "ovs_interfaceid": "1344eed9-36fe-4fce-a572-94a310f2d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:55:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=1344eed9-36fe-4fce-a572-94a310f2d618,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344eed9-36') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:55:46 user nova-compute[72990]: DEBUG os_vif [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=1344eed9-36fe-4fce-a572-94a310f2d618,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344eed9-36') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:55:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1344eed9-36, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:55:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:55:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:46 user nova-compute[72990]: INFO os_vif [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:a6:b0,bridge_name='br-int',has_traffic_filtering=True,id=1344eed9-36fe-4fce-a572-94a310f2d618,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344eed9-36')
Aug 27 03:55:46 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Deleting instance files /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33_del
Aug 27 03:55:46 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Deletion of /opt/stack/data/nova/instances/15a88698-88d1-4c6b-9e40-98b618978a33_del complete
Aug 27 03:55:46 user nova-compute[72990]: INFO nova.compute.manager [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 27 03:55:46 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:55:46 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:55:46 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:55:47 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:55:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:47 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Took 1.17 seconds to deallocate network for instance.
Aug 27 03:55:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-3e347962-6f91-4e89-bf91-a3e4227547bb req-48821fae-ea76-4a9b-9890-949b79e96f95 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:55:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3e347962-6f91-4e89-bf91-a3e4227547bb req-48821fae-ea76-4a9b-9890-949b79e96f95 service nova] Acquiring lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3e347962-6f91-4e89-bf91-a3e4227547bb req-48821fae-ea76-4a9b-9890-949b79e96f95 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3e347962-6f91-4e89-bf91-a3e4227547bb req-48821fae-ea76-4a9b-9890-949b79e96f95 service nova] Lock "15a88698-88d1-4c6b-9e40-98b618978a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-3e347962-6f91-4e89-bf91-a3e4227547bb req-48821fae-ea76-4a9b-9890-949b79e96f95 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] No waiting events found dispatching network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:55:47 user nova-compute[72990]: WARNING nova.compute.manager [req-3e347962-6f91-4e89-bf91-a3e4227547bb req-48821fae-ea76-4a9b-9890-949b79e96f95 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received unexpected event network-vif-plugged-1344eed9-36fe-4fce-a572-94a310f2d618 for instance with vm_state deleted and task_state None.
Aug 27 03:55:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-3e347962-6f91-4e89-bf91-a3e4227547bb req-48821fae-ea76-4a9b-9890-949b79e96f95 service nova] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Received event network-vif-deleted-1344eed9-36fe-4fce-a572-94a310f2d618 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:55:47 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:55:47 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:55:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:47 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Deleted allocations for instance 15a88698-88d1-4c6b-9e40-98b618978a33
Aug 27 03:55:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a01c06aa-783e-4167-9d9d-848708396621 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "15a88698-88d1-4c6b-9e40-98b618978a33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.770s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:49 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lazy-loading 'pci_requests' on Instance uuid aa475371-4888-4c4b-9b74-4e813b804da6 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:55:49 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lazy-loading 'numa_topology' on Instance uuid aa475371-4888-4c4b-9b74-4e813b804da6 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:55:49 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:55:49 user nova-compute[72990]: INFO nova.compute.claims [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Claim successful on node user
Aug 27 03:55:49 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:55:49 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:55:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:50 user nova-compute[72990]: INFO nova.network.neutron [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updating port 47395266-6458-4699-96ce-7a0d176dc6ac with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 03:55:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:55:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquired lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:55:50 user nova-compute[72990]: DEBUG nova.network.neutron [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:55:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-88742ce1-6ba7-40d1-824d-8a9ec063be35 req-d6aae599-a7dd-4b76-9a09-619008ef84fd service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-changed-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:55:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-88742ce1-6ba7-40d1-824d-8a9ec063be35 req-d6aae599-a7dd-4b76-9a09-619008ef84fd service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Refreshing instance network info cache due to event network-changed-47395266-6458-4699-96ce-7a0d176dc6ac. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:55:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-88742ce1-6ba7-40d1-824d-8a9ec063be35 req-d6aae599-a7dd-4b76-9a09-619008ef84fd service nova] Acquiring lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.network.neutron [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updating instance_info_cache with network_info: [{"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Releasing lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:55:51 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Creating image(s)
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Ensure instance console log exists: /opt/stack/data/nova/instances/aa475371-4888-4c4b-9b74-4e813b804da6/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Start _get_guest_xml network_info=[{"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'caaf4a90-3971-489f-8536-575a8ff322d0', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcKDWLfy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa475371-4888-4c4b-9b74-4e813b804da6', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9c9a333-ea9b-467b-9f8d-8579cc71b083', 'serial': 'c9c9a333-ea9b-467b-9f8d-8579cc71b083'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-88742ce1-6ba7-40d1-824d-8a9ec063be35 req-d6aae599-a7dd-4b76-9a09-619008ef84fd service nova] Acquired lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.network.neutron [req-88742ce1-6ba7-40d1-824d-8a9ec063be35 req-d6aae599-a7dd-4b76-9a09-619008ef84fd service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Refreshing network info cache for port 47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:55:51 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:55:51 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa475371-4888-4c4b-9b74-4e813b804da6 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.objects.base [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Object Instance<aa475371-4888-4c4b-9b74-4e813b804da6> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcKDWLfy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:55:51 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:55:51 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:55:51 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7678467-e2e0-4aba-8d91-e4c85e71fabb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:55:51 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc1bef5-3408-4330-8d9f-560cb13accb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083] added
Aug 27 03:55:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af0d8a6-d7bf-4162-80a8-920a78f3c960]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cc1494-9af4-414c-b481-25374fc72a6a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcKDWLfy {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcKDWLfy" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6c4998-4f7c-4069-bff8-752593e7cafb]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qcKDWLfy'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[01427886-b5ca-4274-bf9d-55b469e0b8cc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[756610cc-0662-4b14-acaa-43cc78b3830f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c8177a-98e1-46bf-8e64-4c1c4f3005fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260]
Aug 27 03:55:51 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260] successful.
Aug 27 03:55:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4fb934-d489-4924-85d7-a730984318ba]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0022cf5-95fb-41b1-9a58-1fd2ef797d76]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:55:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb04357b-6210-4252-b4b9-a9defe82339f]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcKDWLfy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.network.neutron [req-88742ce1-6ba7-40d1-824d-8a9ec063be35 req-d6aae599-a7dd-4b76-9a09-619008ef84fd service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updated VIF entry in instance network info cache for port 47395266-6458-4699-96ce-7a0d176dc6ac. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG nova.network.neutron [req-88742ce1-6ba7-40d1-824d-8a9ec063be35 req-d6aae599-a7dd-4b76-9a09-619008ef84fd service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updating instance_info_cache with network_info: [{"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:55:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-88742ce1-6ba7-40d1-824d-8a9ec063be35 req-d6aae599-a7dd-4b76-9a09-619008ef84fd service nova] Releasing lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '26537333065306661', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537333065306661', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1204888072',display_name='tempest-TestShelveInstance-server-1204888072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1204888072',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2100279265',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='35b53f8f3359444bbc0ef845387a827a',ramdisk_id='',reservation_id='r-lglgy4lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1842874330',owner_user_name='tempest-TestShelveInstance-1842874330-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:55:35Z,user_data=None,user_id='e2aa172fbf7844d390e285244a4f3799',uuid=aa475371-4888-4c4b-9b74-4e813b804da6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Converting VIF {"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lazy-loading 'pci_devices' on Instance uuid aa475371-4888-4c4b-9b74-4e813b804da6 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG nova.objects.base [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Object Instance<aa475371-4888-4c4b-9b74-4e813b804da6> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:55:52 user nova-compute[72990]:   <uuid>aa475371-4888-4c4b-9b74-4e813b804da6</uuid>
Aug 27 03:55:52 user nova-compute[72990]:   <name>instance-00000019</name>
Aug 27 03:55:52 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:55:52 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:55:52 user nova-compute[72990]:   <metadata>
Aug 27 03:55:52 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:55:52 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:55:52 user nova-compute[72990]:       <nova:name>tempest-TestShelveInstance-server-1204888072</nova:name>
Aug 27 03:55:52 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:55:51</nova:creationTime>
Aug 27 03:55:52 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:55:52 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:55:52 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:55:52 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:55:52 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:55:52 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:55:52 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:55:52 user nova-compute[72990]:       <nova:owner>
Aug 27 03:55:52 user nova-compute[72990]:         <nova:user uuid="e2aa172fbf7844d390e285244a4f3799">tempest-TestShelveInstance-1842874330-project-member</nova:user>
Aug 27 03:55:52 user nova-compute[72990]:         <nova:project uuid="35b53f8f3359444bbc0ef845387a827a">tempest-TestShelveInstance-1842874330</nova:project>
Aug 27 03:55:52 user nova-compute[72990]:       </nova:owner>
Aug 27 03:55:52 user nova-compute[72990]:       <nova:ports>
Aug 27 03:55:52 user nova-compute[72990]:         <nova:port uuid="47395266-6458-4699-96ce-7a0d176dc6ac">
Aug 27 03:55:52 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 03:55:52 user nova-compute[72990]:         </nova:port>
Aug 27 03:55:52 user nova-compute[72990]:       </nova:ports>
Aug 27 03:55:52 user nova-compute[72990]:     </nova:instance>
Aug 27 03:55:52 user nova-compute[72990]:   </metadata>
Aug 27 03:55:52 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:55:52 user nova-compute[72990]:     <system>
Aug 27 03:55:52 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:55:52 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:55:52 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:55:52 user nova-compute[72990]:       <entry name="serial">aa475371-4888-4c4b-9b74-4e813b804da6</entry>
Aug 27 03:55:52 user nova-compute[72990]:       <entry name="uuid">aa475371-4888-4c4b-9b74-4e813b804da6</entry>
Aug 27 03:55:52 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:55:52 user nova-compute[72990]:     </system>
Aug 27 03:55:52 user nova-compute[72990]:   </sysinfo>
Aug 27 03:55:52 user nova-compute[72990]:   <os>
Aug 27 03:55:52 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:55:52 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:55:52 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:55:52 user nova-compute[72990]:   </os>
Aug 27 03:55:52 user nova-compute[72990]:   <features>
Aug 27 03:55:52 user nova-compute[72990]:     <acpi/>
Aug 27 03:55:52 user nova-compute[72990]:     <apic/>
Aug 27 03:55:52 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:55:52 user nova-compute[72990]:   </features>
Aug 27 03:55:52 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:55:52 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:55:52 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:55:52 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:55:52 user nova-compute[72990]:   </clock>
Aug 27 03:55:52 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:55:52 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:55:52 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:55:52 user nova-compute[72990]:   </cpu>
Aug 27 03:55:52 user nova-compute[72990]:   <devices>
Aug 27 03:55:52 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 03:55:52 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:55:52 user nova-compute[72990]:       <source dev="/dev/sdb"/>
Aug 27 03:55:52 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:55:52 user nova-compute[72990]:       <serial>c9c9a333-ea9b-467b-9f8d-8579cc71b083</serial>
Aug 27 03:55:52 user nova-compute[72990]:     </disk>
Aug 27 03:55:52 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:55:52 user nova-compute[72990]:       <mac address="fa:16:3e:66:5d:2f"/>
Aug 27 03:55:52 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:55:52 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:55:52 user nova-compute[72990]:       <target dev="tap47395266-64"/>
Aug 27 03:55:52 user nova-compute[72990]:     </interface>
Aug 27 03:55:52 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:55:52 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/aa475371-4888-4c4b-9b74-4e813b804da6/console.log" append="off"/>
Aug 27 03:55:52 user nova-compute[72990]:     </serial>
Aug 27 03:55:52 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:55:52 user nova-compute[72990]:     <video>
Aug 27 03:55:52 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:55:52 user nova-compute[72990]:     </video>
Aug 27 03:55:52 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:55:52 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:55:52 user nova-compute[72990]:     </rng>
Aug 27 03:55:52 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:55:52 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:55:52 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:55:52 user nova-compute[72990]:     </memballoon>
Aug 27 03:55:52 user nova-compute[72990]:   </devices>
Aug 27 03:55:52 user nova-compute[72990]: </domain>
Aug 27 03:55:52 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1204888072',display_name='tempest-TestShelveInstance-server-1204888072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1204888072',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2100279265',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='35b53f8f3359444bbc0ef845387a827a',ramdisk_id='',reservation_id='r-lglgy4lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1842874330',owner_user_name='tempest-TestShelveInstance-1842874330-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:55:35Z,user_data=None,user_id='e2aa172fbf7844d390e285244a4f3799',uuid=aa475371-4888-4c4b-9b74-4e813b804da6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Converting VIF {"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG os_vif [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47395266-64, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47395266-64, col_values=(('external_ids', {'iface-id': '47395266-6458-4699-96ce-7a0d176dc6ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:5d:2f', 'vm-uuid': 'aa475371-4888-4c4b-9b74-4e813b804da6'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:52 user nova-compute[72990]: INFO os_vif [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64')
Aug 27 03:55:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:55:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] No VIF found with MAC fa:16:3e:66:5d:2f, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:55:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-93ed116c-a5b6-4dc5-8b92-f9b129d67bcd req-0e09d119-6283-4b55-a7a7-ec677a8f9fe5 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:55:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-93ed116c-a5b6-4dc5-8b92-f9b129d67bcd req-0e09d119-6283-4b55-a7a7-ec677a8f9fe5 service nova] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-93ed116c-a5b6-4dc5-8b92-f9b129d67bcd req-0e09d119-6283-4b55-a7a7-ec677a8f9fe5 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-93ed116c-a5b6-4dc5-8b92-f9b129d67bcd req-0e09d119-6283-4b55-a7a7-ec677a8f9fe5 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-93ed116c-a5b6-4dc5-8b92-f9b129d67bcd req-0e09d119-6283-4b55-a7a7-ec677a8f9fe5 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] No waiting events found dispatching network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:55:54 user nova-compute[72990]: WARNING nova.compute.manager [req-93ed116c-a5b6-4dc5-8b92-f9b129d67bcd req-0e09d119-6283-4b55-a7a7-ec677a8f9fe5 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received unexpected event network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 03:55:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:56 user nova-compute[72990]: INFO nova.compute.manager [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Unshelving
Aug 27 03:55:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.objects.instance [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'pci_requests' on Instance uuid f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.objects.instance [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'numa_topology' on Instance uuid f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:55:56 user nova-compute[72990]: INFO nova.compute.claims [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Claim successful on node user
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-b282e542-63fd-477c-8198-f80ed418d629 req-ce2801b2-0aaf-4a95-bd11-659103aea807 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b282e542-63fd-477c-8198-f80ed418d629 req-ce2801b2-0aaf-4a95-bd11-659103aea807 service nova] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b282e542-63fd-477c-8198-f80ed418d629 req-ce2801b2-0aaf-4a95-bd11-659103aea807 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b282e542-63fd-477c-8198-f80ed418d629 req-ce2801b2-0aaf-4a95-bd11-659103aea807 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-b282e542-63fd-477c-8198-f80ed418d629 req-ce2801b2-0aaf-4a95-bd11-659103aea807 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] No waiting events found dispatching network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:55:56 user nova-compute[72990]: WARNING nova.compute.manager [req-b282e542-63fd-477c-8198-f80ed418d629 req-ce2801b2-0aaf-4a95-bd11-659103aea807 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received unexpected event network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108556.8468442, aa475371-4888-4c4b-9b74-4e813b804da6 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:55:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] VM Resumed (Lifecycle Event)
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:55:56 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Instance spawned successfully.
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:55:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108556.849327, aa475371-4888-4c4b-9b74-4e813b804da6 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:55:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] VM Started (Lifecycle Event)
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:55:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:55:57 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:55:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f7aafe77-9f67-4c7e-b780-0e03ddfae412 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "aa475371-4888-4c4b-9b74-4e813b804da6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.779s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:57 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:55:57 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:55:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:57 user nova-compute[72990]: INFO nova.network.neutron [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updating port 778be9fb-ea44-464a-b5a7-aea387c1aded with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 03:55:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:55:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:55:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquired lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:55:58 user nova-compute[72990]: DEBUG nova.network.neutron [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:55:58 user nova-compute[72990]: DEBUG nova.compute.manager [req-32f62e60-83fb-4e75-a446-3a5725279c78 req-fea31ec4-3cc9-44d2-bad5-baa160ea8316 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-changed-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:55:58 user nova-compute[72990]: DEBUG nova.compute.manager [req-32f62e60-83fb-4e75-a446-3a5725279c78 req-fea31ec4-3cc9-44d2-bad5-baa160ea8316 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Refreshing instance network info cache due to event network-changed-778be9fb-ea44-464a-b5a7-aea387c1aded. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:55:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-32f62e60-83fb-4e75-a446-3a5725279c78 req-fea31ec4-3cc9-44d2-bad5-baa160ea8316 service nova] Acquiring lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:55:58 user nova-compute[72990]: DEBUG nova.network.neutron [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updating instance_info_cache with network_info: [{"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:55:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Releasing lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:55:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:55:59 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Creating image(s)
Aug 27 03:55:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "/opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:55:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "/opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:55:59 user nova-compute[72990]: DEBUG nova.objects.instance [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:55:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-32f62e60-83fb-4e75-a446-3a5725279c78 req-fea31ec4-3cc9-44d2-bad5-baa160ea8316 service nova] Acquired lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:55:59 user nova-compute[72990]: DEBUG nova.network.neutron [req-32f62e60-83fb-4e75-a446-3a5725279c78 req-fea31ec4-3cc9-44d2-bad5-baa160ea8316 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Refreshing network info cache for port 778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:55:59 user nova-compute[72990]: DEBUG nova.objects.base [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Object Instance<f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:55:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "50718f17bfd949d3b80d0453f5f8e3fd800864b7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:55:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "50718f17bfd949d3b80d0453f5f8e3fd800864b7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7.part --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7.part --force-share --output=json" returned: 0 in 0.214s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:00 user nova-compute[72990]: DEBUG nova.virt.images [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] 0820b467-d4d2-45fc-802e-598c03ea7eba was qcow2, converting to raw {{(pid=72990) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 03:56:00 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 03:56:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7.part /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7.converted {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:00 user nova-compute[72990]: DEBUG nova.network.neutron [req-32f62e60-83fb-4e75-a446-3a5725279c78 req-fea31ec4-3cc9-44d2-bad5-baa160ea8316 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updated VIF entry in instance network info cache for port 778be9fb-ea44-464a-b5a7-aea387c1aded. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:56:00 user nova-compute[72990]: DEBUG nova.network.neutron [req-32f62e60-83fb-4e75-a446-3a5725279c78 req-fea31ec4-3cc9-44d2-bad5-baa160ea8316 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updating instance_info_cache with network_info: [{"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:56:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-32f62e60-83fb-4e75-a446-3a5725279c78 req-fea31ec4-3cc9-44d2-bad5-baa160ea8316 service nova] Releasing lock "refresh_cache-f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108546.0733528, 15a88698-88d1-4c6b-9e40-98b618978a33 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:56:01 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] VM Stopped (Lifecycle Event)
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7.part /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7.converted" returned: 0 in 0.739s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7.converted --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7efbf354-8c21-4c4b-a902-2f3462072fcb None None] [instance: 15a88698-88d1-4c6b-9e40-98b618978a33] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "50718f17bfd949d3b80d0453f5f8e3fd800864b7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.315s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7 --force-share --output=json" returned: 0 in 0.230s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "50718f17bfd949d3b80d0453f5f8e3fd800864b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "50718f17bfd949d3b80d0453f5f8e3fd800864b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7 --force-share --output=json" returned: 0 in 0.214s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7,backing_fmt=raw /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7,backing_fmt=raw /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk 1073741824" returned: 0 in 0.059s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "50718f17bfd949d3b80d0453f5f8e3fd800864b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7 --force-share --output=json" returned: 0 in 0.252s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:02 user nova-compute[72990]: DEBUG nova.objects.instance [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'migration_context' on Instance uuid f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:56:02 user nova-compute[72990]: DEBUG nova.objects.base [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Object Instance<f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:56:02 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Rebasing disk image.
Aug 27 03:56:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.229s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 -F raw /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 -F raw /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk" returned: 0 in 3.029s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Ensure instance console log exists: /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Start _get_guest_xml network_info=[{"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='758a9e4cb9f2e69f47552e509674007f',container_format='bare',created_at=2023-08-27T03:54:03Z,direct_url=<?>,disk_format='qcow2',id=0820b467-d4d2-45fc-802e-598c03ea7eba,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-886886887-shelved',owner='bd44d92dded643eb89d955dbf6b4d1e3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T03:54:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:56:05 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:56:05 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='758a9e4cb9f2e69f47552e509674007f',container_format='bare',created_at=2023-08-27T03:54:03Z,direct_url=<?>,disk_format='qcow2',id=0820b467-d4d2-45fc-802e-598c03ea7eba,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-886886887-shelved',owner='bd44d92dded643eb89d955dbf6b4d1e3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T03:54:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.objects.instance [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.objects.base [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Object Instance<f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-886886887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-886886887',id=27,image_ref='0820b467-d4d2-45fc-802e-598c03ea7eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-631728363',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bd44d92dded643eb89d955dbf6b4d1e3',ramdisk_id='',reservation_id='r-nh5nv47v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2085503517',owner_user_name='tempest-AttachVolumeShelveTestJSON-2085503517-project-member',shelved_at='2023-08-27T03:54:07.860742',shelved_host='user',shelved_image_id='0820b467-d4d2-45fc-802e-598c03ea7eba'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be8e872f1de4248a557155ff1c4f5ec',uuid=f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converting VIF {"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.objects.instance [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'pci_devices' on Instance uuid f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.objects.base [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Object Instance<f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:56:05 user nova-compute[72990]:   <uuid>f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d</uuid>
Aug 27 03:56:05 user nova-compute[72990]:   <name>instance-0000001b</name>
Aug 27 03:56:05 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:56:05 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:56:05 user nova-compute[72990]:   <metadata>
Aug 27 03:56:05 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:56:05 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:56:05 user nova-compute[72990]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-886886887</nova:name>
Aug 27 03:56:05 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:56:05</nova:creationTime>
Aug 27 03:56:05 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:56:05 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:56:05 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:56:05 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:56:05 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:56:05 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:56:05 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:56:05 user nova-compute[72990]:       <nova:owner>
Aug 27 03:56:05 user nova-compute[72990]:         <nova:user uuid="0be8e872f1de4248a557155ff1c4f5ec">tempest-AttachVolumeShelveTestJSON-2085503517-project-member</nova:user>
Aug 27 03:56:05 user nova-compute[72990]:         <nova:project uuid="bd44d92dded643eb89d955dbf6b4d1e3">tempest-AttachVolumeShelveTestJSON-2085503517</nova:project>
Aug 27 03:56:05 user nova-compute[72990]:       </nova:owner>
Aug 27 03:56:05 user nova-compute[72990]:       <nova:root type="image" uuid="0820b467-d4d2-45fc-802e-598c03ea7eba"/>
Aug 27 03:56:05 user nova-compute[72990]:       <nova:ports>
Aug 27 03:56:05 user nova-compute[72990]:         <nova:port uuid="778be9fb-ea44-464a-b5a7-aea387c1aded">
Aug 27 03:56:05 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 03:56:05 user nova-compute[72990]:         </nova:port>
Aug 27 03:56:05 user nova-compute[72990]:       </nova:ports>
Aug 27 03:56:05 user nova-compute[72990]:     </nova:instance>
Aug 27 03:56:05 user nova-compute[72990]:   </metadata>
Aug 27 03:56:05 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:56:05 user nova-compute[72990]:     <system>
Aug 27 03:56:05 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:56:05 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:56:05 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:56:05 user nova-compute[72990]:       <entry name="serial">f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d</entry>
Aug 27 03:56:05 user nova-compute[72990]:       <entry name="uuid">f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d</entry>
Aug 27 03:56:05 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:56:05 user nova-compute[72990]:     </system>
Aug 27 03:56:05 user nova-compute[72990]:   </sysinfo>
Aug 27 03:56:05 user nova-compute[72990]:   <os>
Aug 27 03:56:05 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:56:05 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:56:05 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:56:05 user nova-compute[72990]:   </os>
Aug 27 03:56:05 user nova-compute[72990]:   <features>
Aug 27 03:56:05 user nova-compute[72990]:     <acpi/>
Aug 27 03:56:05 user nova-compute[72990]:     <apic/>
Aug 27 03:56:05 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:56:05 user nova-compute[72990]:   </features>
Aug 27 03:56:05 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:56:05 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:56:05 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:56:05 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:56:05 user nova-compute[72990]:   </clock>
Aug 27 03:56:05 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:56:05 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:56:05 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:56:05 user nova-compute[72990]:   </cpu>
Aug 27 03:56:05 user nova-compute[72990]:   <devices>
Aug 27 03:56:05 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:56:05 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:56:05 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk"/>
Aug 27 03:56:05 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:56:05 user nova-compute[72990]:     </disk>
Aug 27 03:56:05 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:56:05 user nova-compute[72990]:       <mac address="fa:16:3e:1f:dd:13"/>
Aug 27 03:56:05 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:56:05 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:56:05 user nova-compute[72990]:       <target dev="tap778be9fb-ea"/>
Aug 27 03:56:05 user nova-compute[72990]:     </interface>
Aug 27 03:56:05 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:56:05 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/console.log" append="off"/>
Aug 27 03:56:05 user nova-compute[72990]:     </serial>
Aug 27 03:56:05 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:56:05 user nova-compute[72990]:     <video>
Aug 27 03:56:05 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:56:05 user nova-compute[72990]:     </video>
Aug 27 03:56:05 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:56:05 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:56:05 user nova-compute[72990]:     </rng>
Aug 27 03:56:05 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:56:05 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:56:05 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:56:05 user nova-compute[72990]:     </memballoon>
Aug 27 03:56:05 user nova-compute[72990]:   </devices>
Aug 27 03:56:05 user nova-compute[72990]: </domain>
Aug 27 03:56:05 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-886886887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-886886887',id=27,image_ref='0820b467-d4d2-45fc-802e-598c03ea7eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-631728363',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bd44d92dded643eb89d955dbf6b4d1e3',ramdisk_id='',reservation_id='r-nh5nv47v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2085503517',owner_user_name='tempest-AttachVolumeShelveTestJSON-2085503517-project-member',shelved_at='2023-08-27T03:54:07.860742',shelved_host='user',shelved_image_id='0820b467-d4d2-45fc-802e-598c03ea7eba'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be8e872f1de4248a557155ff1c4f5ec',uuid=f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converting VIF {"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG os_vif [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap778be9fb-ea, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap778be9fb-ea, col_values=(('external_ids', {'iface-id': '778be9fb-ea44-464a-b5a7-aea387c1aded', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:dd:13', 'vm-uuid': 'f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:05 user nova-compute[72990]: INFO os_vif [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea')
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:56:05 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] No VIF found with MAC fa:16:3e:1f:dd:13, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:56:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-46f1e039-a98b-459d-be72-a9eaaa946965 req-42ba5e39-4f40-461a-92ca-2b13df841277 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-46f1e039-a98b-459d-be72-a9eaaa946965 req-42ba5e39-4f40-461a-92ca-2b13df841277 service nova] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-46f1e039-a98b-459d-be72-a9eaaa946965 req-42ba5e39-4f40-461a-92ca-2b13df841277 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-46f1e039-a98b-459d-be72-a9eaaa946965 req-42ba5e39-4f40-461a-92ca-2b13df841277 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-46f1e039-a98b-459d-be72-a9eaaa946965 req-42ba5e39-4f40-461a-92ca-2b13df841277 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] No waiting events found dispatching network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:07 user nova-compute[72990]: WARNING nova.compute.manager [req-46f1e039-a98b-459d-be72-a9eaaa946965 req-42ba5e39-4f40-461a-92ca-2b13df841277 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received unexpected event network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 03:56:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-2dedf6e1-5f6d-419d-b6be-794f2b591811 req-629926d6-7a75-422c-a5ed-0bd5bfa2735a service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2dedf6e1-5f6d-419d-b6be-794f2b591811 req-629926d6-7a75-422c-a5ed-0bd5bfa2735a service nova] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2dedf6e1-5f6d-419d-b6be-794f2b591811 req-629926d6-7a75-422c-a5ed-0bd5bfa2735a service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2dedf6e1-5f6d-419d-b6be-794f2b591811 req-629926d6-7a75-422c-a5ed-0bd5bfa2735a service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-2dedf6e1-5f6d-419d-b6be-794f2b591811 req-629926d6-7a75-422c-a5ed-0bd5bfa2735a service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] No waiting events found dispatching network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:09 user nova-compute[72990]: WARNING nova.compute.manager [req-2dedf6e1-5f6d-419d-b6be-794f2b591811 req-629926d6-7a75-422c-a5ed-0bd5bfa2735a service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received unexpected event network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 03:56:09 user nova-compute[72990]: DEBUG nova.compute.manager [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:56:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:56:09 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108569.748269, f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:56:09 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] VM Resumed (Lifecycle Event)
Aug 27 03:56:09 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Instance spawned successfully.
Aug 27 03:56:09 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:56:09 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:56:09 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:56:09 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108569.7499084, f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:56:09 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] VM Started (Lifecycle Event)
Aug 27 03:56:09 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:56:09 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:56:09 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:56:10 user nova-compute[72990]: DEBUG nova.compute.manager [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:56:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-833bdee2-d501-4c3c-8d34-f345706c1db9 tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.603s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "d4f94cba-21ec-42a8-babc-859becde2c82" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:10 user nova-compute[72990]: DEBUG nova.compute.manager [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Going to confirm migration 2 {{(pid=72990) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 27 03:56:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:56:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquired lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:56:11 user nova-compute[72990]: DEBUG nova.network.neutron [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:56:11 user nova-compute[72990]: DEBUG nova.objects.instance [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lazy-loading 'info_cache' on Instance uuid d4f94cba-21ec-42a8-babc-859becde2c82 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:56:12 user nova-compute[72990]: DEBUG nova.network.neutron [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updating instance_info_cache with network_info: [{"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:56:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Releasing lock "refresh_cache-d4f94cba-21ec-42a8-babc-859becde2c82" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:56:12 user nova-compute[72990]: DEBUG nova.objects.instance [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lazy-loading 'migration_context' on Instance uuid d4f94cba-21ec-42a8-babc-859becde2c82 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:56:12 user nova-compute[72990]: DEBUG nova.objects.base [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Object Instance<d4f94cba-21ec-42a8-babc-859becde2c82> lazy-loaded attributes: info_cache,migration_context {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 03:56:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:12 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:56:12 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:56:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.548s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:13 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Deleted allocation for migration 12409cc1-101b-4d76-bc54-53f0a795232c
Aug 27 03:56:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-15f63088-3f46-4989-84b2-636c87de8dd6 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "d4f94cba-21ec-42a8-babc-859becde2c82" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.249s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:23 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 03:56:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] There are 0 instances to clean {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 03:56:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:33 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:56:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:56:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:56:36 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:56:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-7937834a-c6cf-4c4c-90b1-129c60e0a93b req-eb977b50-5107-4d05-88f8-b1c2a19dc1a3 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-changed-0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-7937834a-c6cf-4c4c-90b1-129c60e0a93b req-eb977b50-5107-4d05-88f8-b1c2a19dc1a3 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing instance network info cache due to event network-changed-0c20a87d-20ab-48b0-925a-34cc951b54ba. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7937834a-c6cf-4c4c-90b1-129c60e0a93b req-eb977b50-5107-4d05-88f8-b1c2a19dc1a3 service nova] Acquiring lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7937834a-c6cf-4c4c-90b1-129c60e0a93b req-eb977b50-5107-4d05-88f8-b1c2a19dc1a3 service nova] Acquired lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG nova.network.neutron [req-7937834a-c6cf-4c4c-90b1-129c60e0a93b req-eb977b50-5107-4d05-88f8-b1c2a19dc1a3 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Refreshing network info cache for port 0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:38 user nova-compute[72990]: DEBUG nova.network.neutron [req-7937834a-c6cf-4c4c-90b1-129c60e0a93b req-eb977b50-5107-4d05-88f8-b1c2a19dc1a3 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updated VIF entry in instance network info cache for port 0c20a87d-20ab-48b0-925a-34cc951b54ba. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:56:38 user nova-compute[72990]: DEBUG nova.network.neutron [req-7937834a-c6cf-4c4c-90b1-129c60e0a93b req-eb977b50-5107-4d05-88f8-b1c2a19dc1a3 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [{"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "673498bd-0a4d-499d-8aaf-1bd148132f98", "address": "fa:16:3e:2b:c9:8c", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673498bd-0a", "ovs_interfaceid": "673498bd-0a4d-499d-8aaf-1bd148132f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:56:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7937834a-c6cf-4c4c-90b1-129c60e0a93b req-eb977b50-5107-4d05-88f8-b1c2a19dc1a3 service nova] Releasing lock "refresh_cache-1e214476-7101-478d-9091-a3ddb56f9307" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:56:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:56:39 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:56:39 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7159MB free_disk=24.961437225341797GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 6a44010b-9a96-4343-a35c-1f212d21e47b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 250288e9-5421-4757-9258-fa1cf0c3be2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 1e214476-7101-478d-9091-a3ddb56f9307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance d4f94cba-21ec-42a8-babc-859becde2c82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aa475371-4888-4c4b-9b74-4e813b804da6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing inventories for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating ProviderTree inventory for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating inventory in ProviderTree for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing aggregate associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, aggregates: None {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing trait associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "1e214476-7101-478d-9091-a3ddb56f9307" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:39 user nova-compute[72990]: INFO nova.compute.manager [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Terminating instance
Aug 27 03:56:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.199s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-15546e15-b19d-4694-9e23-e286e1cd554b req-229abeab-feef-479f-bd4a-5fbe28702368 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-15546e15-b19d-4694-9e23-e286e1cd554b req-229abeab-feef-479f-bd4a-5fbe28702368 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-15546e15-b19d-4694-9e23-e286e1cd554b req-229abeab-feef-479f-bd4a-5fbe28702368 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-15546e15-b19d-4694-9e23-e286e1cd554b req-229abeab-feef-479f-bd4a-5fbe28702368 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-15546e15-b19d-4694-9e23-e286e1cd554b req-229abeab-feef-479f-bd4a-5fbe28702368 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-unplugged-0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-15546e15-b19d-4694-9e23-e286e1cd554b req-229abeab-feef-479f-bd4a-5fbe28702368 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-0c20a87d-20ab-48b0-925a-34cc951b54ba for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-7aefb385-220f-45b5-8380-22353cd0286b req-49f2c158-d50a-46f8-a049-1d9d55e989e0 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7aefb385-220f-45b5-8380-22353cd0286b req-49f2c158-d50a-46f8-a049-1d9d55e989e0 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7aefb385-220f-45b5-8380-22353cd0286b req-49f2c158-d50a-46f8-a049-1d9d55e989e0 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7aefb385-220f-45b5-8380-22353cd0286b req-49f2c158-d50a-46f8-a049-1d9d55e989e0 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-7aefb385-220f-45b5-8380-22353cd0286b req-49f2c158-d50a-46f8-a049-1d9d55e989e0 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-unplugged-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-7aefb385-220f-45b5-8380-22353cd0286b req-49f2c158-d50a-46f8-a049-1d9d55e989e0 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:56:41 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Instance destroyed successfully.
Aug 27 03:56:41 user nova-compute[72990]: DEBUG nova.objects.instance [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lazy-loading 'resources' on Instance uuid 1e214476-7101-478d-9091-a3ddb56f9307 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:54:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:24:90,bridge_name='br-int',has_traffic_filtering=True,id=0c20a87d-20ab-48b0-925a-34cc951b54ba,network=Network(489e7ccb-0047-439d-b180-be939ef4c11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c20a87d-20') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:24:90,bridge_name='br-int',has_traffic_filtering=True,id=0c20a87d-20ab-48b0-925a-34cc951b54ba,network=Network(489e7ccb-0047-439d-b180-be939ef4c11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c20a87d-20') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c20a87d-20, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: INFO os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:24:90,bridge_name='br-int',has_traffic_filtering=True,id=0c20a87d-20ab-48b0-925a-34cc951b54ba,network=Network(489e7ccb-0047-439d-b180-be939ef4c11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c20a87d-20')
Aug 27 03:56:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:54:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:49:28,bridge_name='br-int',has_traffic_filtering=True,id=91208a0e-6d0b-4af4-9996-a282702c92af,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91208a0e-6d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:49:28,bridge_name='br-int',has_traffic_filtering=True,id=91208a0e-6d0b-4af4-9996-a282702c92af,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91208a0e-6d') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91208a0e-6d, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: INFO os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:49:28,bridge_name='br-int',has_traffic_filtering=True,id=91208a0e-6d0b-4af4-9996-a282702c92af,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91208a0e-6d')
Aug 27 03:56:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:54:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e5:0d,bridge_name='br-int',has_traffic_filtering=True,id=33321514-f420-4c28-b775-13ef897aa0ef,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33321514-f4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e5:0d,bridge_name='br-int',has_traffic_filtering=True,id=33321514-f420-4c28-b775-13ef897aa0ef,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33321514-f4') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33321514-f4, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:42 user nova-compute[72990]: INFO os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e5:0d,bridge_name='br-int',has_traffic_filtering=True,id=33321514-f420-4c28-b775-13ef897aa0ef,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33321514-f4')
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:54:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6a:86,bridge_name='br-int',has_traffic_filtering=True,id=5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1bea33-f8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6a:86,bridge_name='br-int',has_traffic_filtering=True,id=5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1bea33-f8') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f1bea33-f8, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:42 user nova-compute[72990]: INFO os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6a:86,bridge_name='br-int',has_traffic_filtering=True,id=5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1bea33-f8')
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:54:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "673498bd-0a4d-499d-8aaf-1bd148132f98", "address": "fa:16:3e:2b:c9:8c", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673498bd-0a", "ovs_interfaceid": "673498bd-0a4d-499d-8aaf-1bd148132f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "673498bd-0a4d-499d-8aaf-1bd148132f98", "address": "fa:16:3e:2b:c9:8c", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673498bd-0a", "ovs_interfaceid": "673498bd-0a4d-499d-8aaf-1bd148132f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c9:8c,bridge_name='br-int',has_traffic_filtering=True,id=673498bd-0a4d-499d-8aaf-1bd148132f98,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673498bd-0a') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c9:8c,bridge_name='br-int',has_traffic_filtering=True,id=673498bd-0a4d-499d-8aaf-1bd148132f98,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673498bd-0a') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap673498bd-0a, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1bc224f-78b4-4c89-bcd0-b9f29b9412b5 req-80da7939-d812-4bea-878d-af6d746fdbe4 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-91208a0e-6d0b-4af4-9996-a282702c92af {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1bc224f-78b4-4c89-bcd0-b9f29b9412b5 req-80da7939-d812-4bea-878d-af6d746fdbe4 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1bc224f-78b4-4c89-bcd0-b9f29b9412b5 req-80da7939-d812-4bea-878d-af6d746fdbe4 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1bc224f-78b4-4c89-bcd0-b9f29b9412b5 req-80da7939-d812-4bea-878d-af6d746fdbe4 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1bc224f-78b4-4c89-bcd0-b9f29b9412b5 req-80da7939-d812-4bea-878d-af6d746fdbe4 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-unplugged-91208a0e-6d0b-4af4-9996-a282702c92af {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1bc224f-78b4-4c89-bcd0-b9f29b9412b5 req-80da7939-d812-4bea-878d-af6d746fdbe4 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-91208a0e-6d0b-4af4-9996-a282702c92af for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:42 user nova-compute[72990]: INFO os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c9:8c,bridge_name='br-int',has_traffic_filtering=True,id=673498bd-0a4d-499d-8aaf-1bd148132f98,network=Network(befd7f74-f584-413a-ad43-027b3c3ea4ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673498bd-0a')
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:54:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=ed12bcc2-2daf-47c0-8571-ac118426948c,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped12bcc2-2d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=ed12bcc2-2daf-47c0-8571-ac118426948c,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped12bcc2-2d') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped12bcc2-2d, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:42 user nova-compute[72990]: INFO os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=ed12bcc2-2daf-47c0-8571-ac118426948c,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped12bcc2-2d')
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T03:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-873791915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-873791915',id=29,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFjCs6wtexw2+e4e095aPdim/C2yRtqvpVj0h2d9XCqXWJx4ESPQpJo+PmLuQYKpOW1nd4P2CcIha+vc4EAAOmdF4nHDloTJ5sCWdce8VYTxWMfNUYZ3G4q3zsx1P0DdA==',key_name='tempest-keypair-1454584710',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:54:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26dab62a21d64da685223dcf47c8e957',ramdisk_id='',reservation_id='r-bs6rwkje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-139511590',owner_user_name='tempest-TaggedBootDevicesTest-139511590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e7e38d016f42cdada7214766a153be',uuid=1e214476-7101-478d-9091-a3ddb56f9307,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converting VIF {"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:f7,bridge_name='br-int',has_traffic_filtering=True,id=98474278-76fb-4c4a-933c-9cde3c86f3d5,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98474278-76') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:f7,bridge_name='br-int',has_traffic_filtering=True,id=98474278-76fb-4c4a-933c-9cde3c86f3d5,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98474278-76') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98474278-76, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:56:42 user nova-compute[72990]: INFO os_vif [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:f7,bridge_name='br-int',has_traffic_filtering=True,id=98474278-76fb-4c4a-933c-9cde3c86f3d5,network=Network(69fd2d76-e59e-45ab-8d30-fc82d16480a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98474278-76')
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EchzrURT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:56:42 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7470c2-3585-4453-b17d-07fe65bf5a4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfa7a87-5044-48b3-a36d-0de3a7a89118]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f46e9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c'): ({'sdd'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Removing single pathed devices sdd {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[814738d2-d376-4c2d-b29a-30e14d9c2112]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02b5fdb-62d8-4f94-94e5-fae17df9dc30]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Flushing IO for device /dev/sdd {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9acea2b-739b-4842-97e0-d0ca16b455fb]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c841412-40b2-4062-816b-74e50bba8ccd]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e2e713-7e95-4f0b-98c4-70c3c04e7943]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Updating instance_info_cache with network_info: [{"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-034cb1d6-25b5-499d-81b1-36adf2385242" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3575f0-4097-4d5a-b212-0a339169c4ab]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c, portal: 172.16.0.220,3260]
Aug 27 03:56:42 user nova-compute[72990]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c, portal: 172.16.0.220,3260] successful.
Aug 27 03:56:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07aa8dc4-38b8-4b06-b244-c161b498550c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c2da5e-897b-483a-8ec3-51a881a6643b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] <== disconnect_volume: return (374ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTHgDmKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:56:42 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[480aedff-6deb-4bf6-8b7a-ec49ca5d5d1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97e00e8-59a9-4db3-b731-37b5881ad9f9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:56:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa714390f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2'): ({'sde'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Removing single pathed devices sde {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbac0569-edd8-4663-8f9e-18ae97c87d33]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c21103-dbf2-4ae1-8dd5-1f2d0bc399a0]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Flushing IO for device /dev/sde {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1aa74e-d5e5-4cda-a44b-58d7029f2a3b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[041e0403-0b4d-43cd-8853-749188317afc]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] SCSI volumes sde have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:42 user nova-compute[72990]: WARNING nova.compute.manager [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-0c20a87d-20ab-48b0-925a-34cc951b54ba for instance with vm_state active and task_state deleting.
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-33321514-f420-4c28-b775-13ef897aa0ef {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-unplugged-33321514-f420-4c28-b775-13ef897aa0ef {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-33321514-f420-4c28-b775-13ef897aa0ef for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-33321514-f420-4c28-b775-13ef897aa0ef {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-33321514-f420-4c28-b775-13ef897aa0ef {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:42 user nova-compute[72990]: WARNING nova.compute.manager [req-4bfb4943-330f-4a31-9d93-0c5831c6d7db req-c892292e-1e1e-429b-8840-918be4302964 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-33321514-f420-4c28-b775-13ef897aa0ef for instance with vm_state active and task_state deleting.
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae51931-8a73-4bf5-9dcd-ce571568f4f9]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03ca97e-fcc4-4bf5-bc18-4025c33e582a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2, portal: 172.16.0.220,3260]
Aug 27 03:56:42 user nova-compute[72990]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2, portal: 172.16.0.220,3260] successful.
Aug 27 03:56:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70a5caa-0c7e-4185-b87f-9fcdb11f9dd2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc08e8a3-5a92-4152-ae30-4b8506d67a70]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] <== disconnect_volume: return (399ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:56:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZyShUnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:56:43 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae98848e-5c30-4e97-9a40-db0dbb0db3bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:43 user nova-compute[72990]: WARNING nova.compute.manager [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c for instance with vm_state active and task_state deleting.
Aug 27 03:56:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-unplugged-98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-98474278-76fb-4c4a-933c-9cde3c86f3d5 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:43 user nova-compute[72990]: WARNING nova.compute.manager [req-1ab81cfe-08b6-49aa-9000-5e038090b180 req-a6419a24-6c5c-4340-a0ae-cc12ada9387c service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-98474278-76fb-4c4a-933c-9cde3c86f3d5 for instance with vm_state active and task_state deleting.
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e2625e-0bc1-4942-a51a-b66b10489abe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:56:43 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:56:43 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:56:43 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:56:43 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:56:43 user nova-compute[72990]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:56:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:56:43 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:56:43 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:56:43 user nova-compute[72990]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 (non-flash)
Aug 27 03:56:43 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:56:43 user nova-compute[72990]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:56:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4309090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a136dd1e-dd36-403c-a2fb-0b391d6d878a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b290d0-e3c7-4e2f-9cfb-9a32d284e317]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f8f13c-0e2c-406e-9798-871e5490d083]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccd04fc-6080-4840-932c-96690a56d440]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d6067d-16eb-460b-93e2-ed24a32a0209]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4566f3c4-9536-4794-b2e6-8c552a5297e8]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8, portal: 172.16.0.220,3260]
Aug 27 03:56:43 user nova-compute[72990]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8, portal: 172.16.0.220,3260] successful.
Aug 27 03:56:43 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe96fc7b-e462-48e7-9786-853341ffcac8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd9c3ef-7342-412c-a1e6-afb146c37e6f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] <== disconnect_volume: return (344ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:56:43 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Deleting instance files /opt/stack/data/nova/instances/1e214476-7101-478d-9091-a3ddb56f9307_del
Aug 27 03:56:43 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Deletion of /opt/stack/data/nova/instances/1e214476-7101-478d-9091-a3ddb56f9307_del complete
Aug 27 03:56:43 user nova-compute[72990]: INFO nova.compute.manager [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Took 3.50 seconds to destroy the instance on the hypervisor.
Aug 27 03:56:43 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:56:43 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-91208a0e-6d0b-4af4-9996-a282702c92af {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-91208a0e-6d0b-4af4-9996-a282702c92af {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:44 user nova-compute[72990]: WARNING nova.compute.manager [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-91208a0e-6d0b-4af4-9996-a282702c92af for instance with vm_state active and task_state deleting.
Aug 27 03:56:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-unplugged-673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-673498bd-0a4d-499d-8aaf-1bd148132f98 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:44 user nova-compute[72990]: WARNING nova.compute.manager [req-6a318b2d-8c75-46a5-b28a-695413906325 req-946f1511-7224-4b9e-9f21-31272ab00a15 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-673498bd-0a4d-499d-8aaf-1bd148132f98 for instance with vm_state active and task_state deleting.
Aug 27 03:56:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-54ce54ce-a154-409b-952c-2996b6e7cc52 req-77035d66-1677-4a00-bd8f-ff1cca1c22b7 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-54ce54ce-a154-409b-952c-2996b6e7cc52 req-77035d66-1677-4a00-bd8f-ff1cca1c22b7 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-54ce54ce-a154-409b-952c-2996b6e7cc52 req-77035d66-1677-4a00-bd8f-ff1cca1c22b7 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-54ce54ce-a154-409b-952c-2996b6e7cc52 req-77035d66-1677-4a00-bd8f-ff1cca1c22b7 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-54ce54ce-a154-409b-952c-2996b6e7cc52 req-77035d66-1677-4a00-bd8f-ff1cca1c22b7 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-unplugged-ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-54ce54ce-a154-409b-952c-2996b6e7cc52 req-77035d66-1677-4a00-bd8f-ff1cca1c22b7 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-unplugged-ed12bcc2-2daf-47c0-8571-ac118426948c for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:56:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-54ce54ce-a154-409b-952c-2996b6e7cc52 req-77035d66-1677-4a00-bd8f-ff1cca1c22b7 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-plugged-ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-54ce54ce-a154-409b-952c-2996b6e7cc52 req-77035d66-1677-4a00-bd8f-ff1cca1c22b7 service nova] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-54ce54ce-a154-409b-952c-2996b6e7cc52 req-77035d66-1677-4a00-bd8f-ff1cca1c22b7 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-54ce54ce-a154-409b-952c-2996b6e7cc52 req-77035d66-1677-4a00-bd8f-ff1cca1c22b7 service nova] Lock "1e214476-7101-478d-9091-a3ddb56f9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-54ce54ce-a154-409b-952c-2996b6e7cc52 req-77035d66-1677-4a00-bd8f-ff1cca1c22b7 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] No waiting events found dispatching network-vif-plugged-ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:46 user nova-compute[72990]: WARNING nova.compute.manager [req-54ce54ce-a154-409b-952c-2996b6e7cc52 req-77035d66-1677-4a00-bd8f-ff1cca1c22b7 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received unexpected event network-vif-plugged-ed12bcc2-2daf-47c0-8571-ac118426948c for instance with vm_state active and task_state deleting.
Aug 27 03:56:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-86115e0c-a4c0-48b3-aee6-b4cfd8695fbe req-0dc33b85-8077-4ee2-a597-315a36abf308 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-deleted-673498bd-0a4d-499d-8aaf-1bd148132f98 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:47 user nova-compute[72990]: INFO nova.compute.manager [req-86115e0c-a4c0-48b3-aee6-b4cfd8695fbe req-0dc33b85-8077-4ee2-a597-315a36abf308 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Neutron deleted interface 673498bd-0a4d-499d-8aaf-1bd148132f98; detaching it from the instance and deleting it from the info cache
Aug 27 03:56:47 user nova-compute[72990]: DEBUG nova.network.neutron [req-86115e0c-a4c0-48b3-aee6-b4cfd8695fbe req-0dc33b85-8077-4ee2-a597-315a36abf308 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [{"id": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "address": "fa:16:3e:37:24:90", "network": {"id": "489e7ccb-0047-439d-b180-be939ef4c11c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2087889154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c20a87d-20", "ovs_interfaceid": "0c20a87d-20ab-48b0-925a-34cc951b54ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:56:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-86115e0c-a4c0-48b3-aee6-b4cfd8695fbe req-0dc33b85-8077-4ee2-a597-315a36abf308 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Detach interface failed, port_id=673498bd-0a4d-499d-8aaf-1bd148132f98, reason: Instance 1e214476-7101-478d-9091-a3ddb56f9307 could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:56:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-361cf93b-0a64-4fc1-be05-29c68033f9a9 req-dd8528ce-a815-484d-af86-5dd61bb4f3ec service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-deleted-0c20a87d-20ab-48b0-925a-34cc951b54ba {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:49 user nova-compute[72990]: INFO nova.compute.manager [req-361cf93b-0a64-4fc1-be05-29c68033f9a9 req-dd8528ce-a815-484d-af86-5dd61bb4f3ec service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Neutron deleted interface 0c20a87d-20ab-48b0-925a-34cc951b54ba; detaching it from the instance and deleting it from the info cache
Aug 27 03:56:49 user nova-compute[72990]: DEBUG nova.network.neutron [req-361cf93b-0a64-4fc1-be05-29c68033f9a9 req-dd8528ce-a815-484d-af86-5dd61bb4f3ec service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [{"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed12bcc2-2daf-47c0-8571-ac118426948c", "address": "fa:16:3e:25:d8:00", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped12bcc2-2d", "ovs_interfaceid": "ed12bcc2-2daf-47c0-8571-ac118426948c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:56:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-361cf93b-0a64-4fc1-be05-29c68033f9a9 req-dd8528ce-a815-484d-af86-5dd61bb4f3ec service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Detach interface failed, port_id=0c20a87d-20ab-48b0-925a-34cc951b54ba, reason: Instance 1e214476-7101-478d-9091-a3ddb56f9307 could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:56:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-361cf93b-0a64-4fc1-be05-29c68033f9a9 req-dd8528ce-a815-484d-af86-5dd61bb4f3ec service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-deleted-ed12bcc2-2daf-47c0-8571-ac118426948c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:49 user nova-compute[72990]: INFO nova.compute.manager [req-361cf93b-0a64-4fc1-be05-29c68033f9a9 req-dd8528ce-a815-484d-af86-5dd61bb4f3ec service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Neutron deleted interface ed12bcc2-2daf-47c0-8571-ac118426948c; detaching it from the instance and deleting it from the info cache
Aug 27 03:56:49 user nova-compute[72990]: DEBUG nova.network.neutron [req-361cf93b-0a64-4fc1-be05-29c68033f9a9 req-dd8528ce-a815-484d-af86-5dd61bb4f3ec service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [{"id": "91208a0e-6d0b-4af4-9996-a282702c92af", "address": "fa:16:3e:23:49:28", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91208a0e-6d", "ovs_interfaceid": "91208a0e-6d0b-4af4-9996-a282702c92af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33321514-f420-4c28-b775-13ef897aa0ef", "address": "fa:16:3e:ba:e5:0d", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33321514-f4", "ovs_interfaceid": "33321514-f420-4c28-b775-13ef897aa0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "address": "fa:16:3e:a4:6a:86", "network": {"id": "befd7f74-f584-413a-ad43-027b3c3ea4ab", "bridge": "br-int", "label": "tempest-device-tagging-net1-2026878229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1bea33-f8", "ovs_interfaceid": "5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "address": "fa:16:3e:da:04:f7", "network": {"id": "69fd2d76-e59e-45ab-8d30-fc82d16480a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457965453", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "26dab62a21d64da685223dcf47c8e957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98474278-76", "ovs_interfaceid": "98474278-76fb-4c4a-933c-9cde3c86f3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:56:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-361cf93b-0a64-4fc1-be05-29c68033f9a9 req-dd8528ce-a815-484d-af86-5dd61bb4f3ec service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Detach interface failed, port_id=ed12bcc2-2daf-47c0-8571-ac118426948c, reason: Instance 1e214476-7101-478d-9091-a3ddb56f9307 could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:56:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Acquiring lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:56:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:49 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:56:49 user nova-compute[72990]: INFO nova.compute.claims [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Claim successful on node user
Aug 27 03:56:50 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:56:50 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Took 6.84 seconds to deallocate network for instance.
Aug 27 03:56:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:56:50 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:56:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG nova.policy [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '897ada6905374909aa17ab70996298c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bac6be9493d42f397f71695cfac79a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:56:50 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Creating image(s)
Aug 27 03:56:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "/opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "/opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.214s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.180s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk 1073741824" returned: 0 in 0.055s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.196s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Successfully created port: 7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Cannot resize image /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Ensure instance console log exists: /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [req-2054b8f3-6c45-41d7-b4e8-445af8262fb9 req-76d460c0-b08c-411e-9f17-d1b4f7233da6 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-deleted-98474278-76fb-4c4a-933c-9cde3c86f3d5 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [req-2054b8f3-6c45-41d7-b4e8-445af8262fb9 req-76d460c0-b08c-411e-9f17-d1b4f7233da6 service nova] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Received event network-vif-deleted-5f1bea33-f8a3-45ce-bc3f-647e7a0e8e1c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:51 user nova-compute[72990]: WARNING nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] While synchronizing instance power states, found 13 instances in the database and 11 instances on the hypervisor.
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 034cb1d6-25b5-499d-81b1-36adf2385242 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid bcd09a59-c950-4143-bfc8-9a89705cca8c {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 7114903d-465a-4ef6-b436-88af52261eae {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 6a44010b-9a96-4343-a35c-1f212d21e47b {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 250288e9-5421-4757-9258-fa1cf0c3be2f {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid d4f94cba-21ec-42a8-babc-859becde2c82 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 0c38f974-36a1-49d3-8749-f6637ddbe6d8 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid aa475371-4888-4c4b-9b74-4e813b804da6 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 1e214476-7101-478d-9091-a3ddb56f9307 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "ca203604-996d-4558-9857-df9e2001c319" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "034cb1d6-25b5-499d-81b1-36adf2385242" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "034cb1d6-25b5-499d-81b1-36adf2385242" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "7835f781-b543-4370-922b-3d2a76f9821b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "bcd09a59-c950-4143-bfc8-9a89705cca8c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "7114903d-465a-4ef6-b436-88af52261eae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "6a44010b-9a96-4343-a35c-1f212d21e47b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "d4f94cba-21ec-42a8-babc-859becde2c82" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "aa475371-4888-4c4b-9b74-4e813b804da6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "1e214476-7101-478d-9091-a3ddb56f9307" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "ca203604-996d-4558-9857-df9e2001c319" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "034cb1d6-25b5-499d-81b1-36adf2385242" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "7114903d-465a-4ef6-b436-88af52261eae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "7835f781-b543-4370-922b-3d2a76f9821b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "d4f94cba-21ec-42a8-babc-859becde2c82" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "aa475371-4888-4c4b-9b74-4e813b804da6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Successfully updated port: 7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Acquiring lock "refresh_cache-0c38f974-36a1-49d3-8749-f6637ddbe6d8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Acquired lock "refresh_cache-0c38f974-36a1-49d3-8749-f6637ddbe6d8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Updating instance_info_cache with network_info: [{"id": "7a2482e8-6313-4ed3-8856-2e716e327071", "address": "fa:16:3e:2e:1a:51", "network": {"id": "3c142189-4e25-4418-9361-4fb4564545fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1876173398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bac6be9493d42f397f71695cfac79a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2482e8-63", "ovs_interfaceid": "7a2482e8-6313-4ed3-8856-2e716e327071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Releasing lock "refresh_cache-0c38f974-36a1-49d3-8749-f6637ddbe6d8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Instance network_info: |[{"id": "7a2482e8-6313-4ed3-8856-2e716e327071", "address": "fa:16:3e:2e:1a:51", "network": {"id": "3c142189-4e25-4418-9361-4fb4564545fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1876173398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bac6be9493d42f397f71695cfac79a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2482e8-63", "ovs_interfaceid": "7a2482e8-6313-4ed3-8856-2e716e327071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Start _get_guest_xml network_info=[{"id": "7a2482e8-6313-4ed3-8856-2e716e327071", "address": "fa:16:3e:2e:1a:51", "network": {"id": "3c142189-4e25-4418-9361-4fb4564545fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1876173398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bac6be9493d42f397f71695cfac79a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2482e8-63", "ovs_interfaceid": "7a2482e8-6313-4ed3-8856-2e716e327071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:56:52 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:56:52 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-356533668',display_name='tempest-VolumesActionsTest-instance-356533668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-356533668',id=30,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bac6be9493d42f397f71695cfac79a0',ramdisk_id='',reservation_id='r-o2252acm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-160165565',owner_user_name='tempest-VolumesActionsTest-160165565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:56:50Z,user_data=None,user_id='897ada6905374909aa17ab70996298c0',uuid=0c38f974-36a1-49d3-8749-f6637ddbe6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a2482e8-6313-4ed3-8856-2e716e327071", "address": "fa:16:3e:2e:1a:51", "network": {"id": "3c142189-4e25-4418-9361-4fb4564545fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1876173398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bac6be9493d42f397f71695cfac79a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2482e8-63", "ovs_interfaceid": "7a2482e8-6313-4ed3-8856-2e716e327071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Converting VIF {"id": "7a2482e8-6313-4ed3-8856-2e716e327071", "address": "fa:16:3e:2e:1a:51", "network": {"id": "3c142189-4e25-4418-9361-4fb4564545fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1876173398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bac6be9493d42f397f71695cfac79a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2482e8-63", "ovs_interfaceid": "7a2482e8-6313-4ed3-8856-2e716e327071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=7a2482e8-6313-4ed3-8856-2e716e327071,network=Network(3c142189-4e25-4418-9361-4fb4564545fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2482e8-63') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.objects.instance [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c38f974-36a1-49d3-8749-f6637ddbe6d8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:56:52 user nova-compute[72990]:   <uuid>0c38f974-36a1-49d3-8749-f6637ddbe6d8</uuid>
Aug 27 03:56:52 user nova-compute[72990]:   <name>instance-0000001e</name>
Aug 27 03:56:52 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:56:52 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:56:52 user nova-compute[72990]:   <metadata>
Aug 27 03:56:52 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:56:52 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:56:52 user nova-compute[72990]:       <nova:name>tempest-VolumesActionsTest-instance-356533668</nova:name>
Aug 27 03:56:52 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:56:52</nova:creationTime>
Aug 27 03:56:52 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:56:52 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:56:52 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:56:52 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:56:52 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:56:52 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:56:52 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:56:52 user nova-compute[72990]:       <nova:owner>
Aug 27 03:56:52 user nova-compute[72990]:         <nova:user uuid="897ada6905374909aa17ab70996298c0">tempest-VolumesActionsTest-160165565-project-member</nova:user>
Aug 27 03:56:52 user nova-compute[72990]:         <nova:project uuid="3bac6be9493d42f397f71695cfac79a0">tempest-VolumesActionsTest-160165565</nova:project>
Aug 27 03:56:52 user nova-compute[72990]:       </nova:owner>
Aug 27 03:56:52 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:56:52 user nova-compute[72990]:       <nova:ports>
Aug 27 03:56:52 user nova-compute[72990]:         <nova:port uuid="7a2482e8-6313-4ed3-8856-2e716e327071">
Aug 27 03:56:52 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 03:56:52 user nova-compute[72990]:         </nova:port>
Aug 27 03:56:52 user nova-compute[72990]:       </nova:ports>
Aug 27 03:56:52 user nova-compute[72990]:     </nova:instance>
Aug 27 03:56:52 user nova-compute[72990]:   </metadata>
Aug 27 03:56:52 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:56:52 user nova-compute[72990]:     <system>
Aug 27 03:56:52 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:56:52 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:56:52 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:56:52 user nova-compute[72990]:       <entry name="serial">0c38f974-36a1-49d3-8749-f6637ddbe6d8</entry>
Aug 27 03:56:52 user nova-compute[72990]:       <entry name="uuid">0c38f974-36a1-49d3-8749-f6637ddbe6d8</entry>
Aug 27 03:56:52 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:56:52 user nova-compute[72990]:     </system>
Aug 27 03:56:52 user nova-compute[72990]:   </sysinfo>
Aug 27 03:56:52 user nova-compute[72990]:   <os>
Aug 27 03:56:52 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:56:52 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:56:52 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:56:52 user nova-compute[72990]:   </os>
Aug 27 03:56:52 user nova-compute[72990]:   <features>
Aug 27 03:56:52 user nova-compute[72990]:     <acpi/>
Aug 27 03:56:52 user nova-compute[72990]:     <apic/>
Aug 27 03:56:52 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:56:52 user nova-compute[72990]:   </features>
Aug 27 03:56:52 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:56:52 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:56:52 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:56:52 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:56:52 user nova-compute[72990]:   </clock>
Aug 27 03:56:52 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:56:52 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:56:52 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:56:52 user nova-compute[72990]:   </cpu>
Aug 27 03:56:52 user nova-compute[72990]:   <devices>
Aug 27 03:56:52 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:56:52 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:56:52 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk"/>
Aug 27 03:56:52 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:56:52 user nova-compute[72990]:     </disk>
Aug 27 03:56:52 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:56:52 user nova-compute[72990]:       <mac address="fa:16:3e:2e:1a:51"/>
Aug 27 03:56:52 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:56:52 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:56:52 user nova-compute[72990]:       <target dev="tap7a2482e8-63"/>
Aug 27 03:56:52 user nova-compute[72990]:     </interface>
Aug 27 03:56:52 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:56:52 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/console.log" append="off"/>
Aug 27 03:56:52 user nova-compute[72990]:     </serial>
Aug 27 03:56:52 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:56:52 user nova-compute[72990]:     <video>
Aug 27 03:56:52 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:56:52 user nova-compute[72990]:     </video>
Aug 27 03:56:52 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:56:52 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:56:52 user nova-compute[72990]:     </rng>
Aug 27 03:56:52 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:56:52 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:56:52 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:56:52 user nova-compute[72990]:     </memballoon>
Aug 27 03:56:52 user nova-compute[72990]:   </devices>
Aug 27 03:56:52 user nova-compute[72990]: </domain>
Aug 27 03:56:52 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-356533668',display_name='tempest-VolumesActionsTest-instance-356533668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-356533668',id=30,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bac6be9493d42f397f71695cfac79a0',ramdisk_id='',reservation_id='r-o2252acm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-160165565',owner_user_name='tempest-VolumesActionsTest-160165565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:56:50Z,user_data=None,user_id='897ada6905374909aa17ab70996298c0',uuid=0c38f974-36a1-49d3-8749-f6637ddbe6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a2482e8-6313-4ed3-8856-2e716e327071", "address": "fa:16:3e:2e:1a:51", "network": {"id": "3c142189-4e25-4418-9361-4fb4564545fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1876173398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bac6be9493d42f397f71695cfac79a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2482e8-63", "ovs_interfaceid": "7a2482e8-6313-4ed3-8856-2e716e327071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Converting VIF {"id": "7a2482e8-6313-4ed3-8856-2e716e327071", "address": "fa:16:3e:2e:1a:51", "network": {"id": "3c142189-4e25-4418-9361-4fb4564545fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1876173398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bac6be9493d42f397f71695cfac79a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2482e8-63", "ovs_interfaceid": "7a2482e8-6313-4ed3-8856-2e716e327071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=7a2482e8-6313-4ed3-8856-2e716e327071,network=Network(3c142189-4e25-4418-9361-4fb4564545fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2482e8-63') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG os_vif [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=7a2482e8-6313-4ed3-8856-2e716e327071,network=Network(3c142189-4e25-4418-9361-4fb4564545fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2482e8-63') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a2482e8-63, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a2482e8-63, col_values=(('external_ids', {'iface-id': '7a2482e8-6313-4ed3-8856-2e716e327071', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:1a:51', 'vm-uuid': '0c38f974-36a1-49d3-8749-f6637ddbe6d8'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:52 user nova-compute[72990]: INFO os_vif [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=7a2482e8-6313-4ed3-8856-2e716e327071,network=Network(3c142189-4e25-4418-9361-4fb4564545fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2482e8-63')
Aug 27 03:56:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72990) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] No VIF found with MAC fa:16:3e:2e:1a:51, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:52 user nova-compute[72990]: INFO nova.compute.manager [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Took 2.61 seconds to detach 3 volumes for instance.
Aug 27 03:56:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:53 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:56:53 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:56:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:53 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Deleted allocations for instance 1e214476-7101-478d-9091-a3ddb56f9307
Aug 27 03:56:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d74b438f-a9fe-4442-9ea5-e63cd04f08fd tempest-TaggedBootDevicesTest-139511590 tempest-TaggedBootDevicesTest-139511590-project-member] Lock "1e214476-7101-478d-9091-a3ddb56f9307" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.532s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "1e214476-7101-478d-9091-a3ddb56f9307" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.595s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:53 user nova-compute[72990]: INFO nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 27 03:56:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "1e214476-7101-478d-9091-a3ddb56f9307" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-4d03456b-6be2-4504-9721-27b12809ed0a req-99a405db-8bee-428d-b073-2b8e20e9eae1 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Received event network-changed-7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-4d03456b-6be2-4504-9721-27b12809ed0a req-99a405db-8bee-428d-b073-2b8e20e9eae1 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Refreshing instance network info cache due to event network-changed-7a2482e8-6313-4ed3-8856-2e716e327071. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:56:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4d03456b-6be2-4504-9721-27b12809ed0a req-99a405db-8bee-428d-b073-2b8e20e9eae1 service nova] Acquiring lock "refresh_cache-0c38f974-36a1-49d3-8749-f6637ddbe6d8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:56:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4d03456b-6be2-4504-9721-27b12809ed0a req-99a405db-8bee-428d-b073-2b8e20e9eae1 service nova] Acquired lock "refresh_cache-0c38f974-36a1-49d3-8749-f6637ddbe6d8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:56:53 user nova-compute[72990]: DEBUG nova.network.neutron [req-4d03456b-6be2-4504-9721-27b12809ed0a req-99a405db-8bee-428d-b073-2b8e20e9eae1 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Refreshing network info cache for port 7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG nova.network.neutron [req-4d03456b-6be2-4504-9721-27b12809ed0a req-99a405db-8bee-428d-b073-2b8e20e9eae1 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Updated VIF entry in instance network info cache for port 7a2482e8-6313-4ed3-8856-2e716e327071. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG nova.network.neutron [req-4d03456b-6be2-4504-9721-27b12809ed0a req-99a405db-8bee-428d-b073-2b8e20e9eae1 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Updating instance_info_cache with network_info: [{"id": "7a2482e8-6313-4ed3-8856-2e716e327071", "address": "fa:16:3e:2e:1a:51", "network": {"id": "3c142189-4e25-4418-9361-4fb4564545fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1876173398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bac6be9493d42f397f71695cfac79a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2482e8-63", "ovs_interfaceid": "7a2482e8-6313-4ed3-8856-2e716e327071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4d03456b-6be2-4504-9721-27b12809ed0a req-99a405db-8bee-428d-b073-2b8e20e9eae1 service nova] Releasing lock "refresh_cache-0c38f974-36a1-49d3-8749-f6637ddbe6d8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:54 user nova-compute[72990]: INFO nova.compute.manager [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Terminating instance
Aug 27 03:56:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:55 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Instance destroyed successfully.
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'resources' on Instance uuid 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-750776012',display_name='tempest-ServerRescueNegativeTestJSON-server-750776012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-750776012',id=3,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='567ed48c72c547c6984851d6ba37e780',ramdisk_id='',reservation_id='r-7it4e73j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-311406621',owner_user_name='tempest-ServerRescueNegativeTestJSON-311406621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:42:23Z,user_data=None,user_id='f0631ab8ad8648e2912d4e554fbbe195',uuid=8ff6c50a-eb4e-4d5a-a213-4fbd7598234f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converting VIF {"id": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "address": "fa:16:3e:df:7e:fa", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb0ae47f-f2", "ovs_interfaceid": "eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:7e:fa,bridge_name='br-int',has_traffic_filtering=True,id=eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb0ae47f-f2') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG os_vif [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:7e:fa,bridge_name='br-int',has_traffic_filtering=True,id=eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb0ae47f-f2') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb0ae47f-f2, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:56:55 user nova-compute[72990]: INFO os_vif [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:7e:fa,bridge_name='br-int',has_traffic_filtering=True,id=eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb0ae47f-f2')
Aug 27 03:56:55 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Deleting instance files /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f_del
Aug 27 03:56:55 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Deletion of /opt/stack/data/nova/instances/8ff6c50a-eb4e-4d5a-a213-4fbd7598234f_del complete
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Received event network-vif-plugged-7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] Acquiring lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] No waiting events found dispatching network-vif-plugged-7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:55 user nova-compute[72990]: WARNING nova.compute.manager [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Received unexpected event network-vif-plugged-7a2482e8-6313-4ed3-8856-2e716e327071 for instance with vm_state building and task_state spawning.
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Received event network-vif-plugged-7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] Acquiring lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] No waiting events found dispatching network-vif-plugged-7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:55 user nova-compute[72990]: WARNING nova.compute.manager [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Received unexpected event network-vif-plugged-7a2482e8-6313-4ed3-8856-2e716e327071 for instance with vm_state building and task_state spawning.
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received event network-vif-unplugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] No waiting events found dispatching network-vif-unplugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received event network-vif-unplugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received event network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] Acquiring lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] No waiting events found dispatching network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:56:55 user nova-compute[72990]: WARNING nova.compute.manager [req-9df8cadc-730d-4f2c-9608-47bc1744fc64 req-be783a6d-888b-43e3-ac9e-715a65c30423 service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received unexpected event network-vif-plugged-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c for instance with vm_state rescued and task_state deleting.
Aug 27 03:56:55 user nova-compute[72990]: INFO nova.compute.manager [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 27 03:56:55 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:56:55 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108616.1514933, 0c38f974-36a1-49d3-8749-f6637ddbe6d8 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:56:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] VM Resumed (Lifecycle Event)
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:56:56 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Instance spawned successfully.
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:56:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108616.1524432, 0c38f974-36a1-49d3-8749-f6637ddbe6d8 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:56:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] VM Started (Lifecycle Event)
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:56:56 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Took 0.55 seconds to deallocate network for instance.
Aug 27 03:56:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:56:56 user nova-compute[72990]: INFO nova.compute.manager [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Took 5.70 seconds to spawn the instance on the hypervisor.
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:56 user nova-compute[72990]: INFO nova.compute.manager [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Took 6.57 seconds to build instance.
Aug 27 03:56:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7b7d2dea-fb8d-42d0-83d8-e2e2b4904057 tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.663s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.529s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:56:56 user nova-compute[72990]: INFO nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:56:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108601.7117832, 1e214476-7101-478d-9091-a3ddb56f9307 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:56:56 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] VM Stopped (Lifecycle Event)
Aug 27 03:56:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-e57d3232-0449-4ba9-a75b-f0a31f904ee1 None None] [instance: 1e214476-7101-478d-9091-a3ddb56f9307] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:56:56 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Deleted allocations for instance 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f
Aug 27 03:56:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f31d9116-fc41-4488-9f10-e29035a33e34 tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "8ff6c50a-eb4e-4d5a-a213-4fbd7598234f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.087s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:56:57 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3cf7921-fb42-4832-839d-2858176a7786 req-a627549b-4958-40e8-9fcc-cb116996af6a service nova] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Received event network-vif-deleted-eb0ae47f-f21a-4d06-99e7-260bc7d5ae5c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:56:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:00 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:10 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108615.5482187, 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:57:10 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] VM Stopped (Lifecycle Event)
Aug 27 03:57:10 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ceec8c6d-2a7f-4795-a14d-1c57e1ef5cad None None] [instance: 8ff6c50a-eb4e-4d5a-a213-4fbd7598234f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:57:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-c4a5fb99-30c5-4770-ac8e-b82565e28e17 req-fc15b2c0-9cd7-494e-b6a9-1fcec9ebe7e8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-changed-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-c4a5fb99-30c5-4770-ac8e-b82565e28e17 req-fc15b2c0-9cd7-494e-b6a9-1fcec9ebe7e8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Refreshing instance network info cache due to event network-changed-47395266-6458-4699-96ce-7a0d176dc6ac. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c4a5fb99-30c5-4770-ac8e-b82565e28e17 req-fc15b2c0-9cd7-494e-b6a9-1fcec9ebe7e8 service nova] Acquiring lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c4a5fb99-30c5-4770-ac8e-b82565e28e17 req-fc15b2c0-9cd7-494e-b6a9-1fcec9ebe7e8 service nova] Acquired lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-c4a5fb99-30c5-4770-ac8e-b82565e28e17 req-fc15b2c0-9cd7-494e-b6a9-1fcec9ebe7e8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Refreshing network info cache for port 47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "aa475371-4888-4c4b-9b74-4e813b804da6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:26 user nova-compute[72990]: INFO nova.compute.manager [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Terminating instance
Aug 27 03:57:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-2c029db9-81c4-4850-be1b-17cfbd8d5ee3 req-156bb3be-02e7-477e-8f7e-2b29bf7fe2d2 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-vif-unplugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2c029db9-81c4-4850-be1b-17cfbd8d5ee3 req-156bb3be-02e7-477e-8f7e-2b29bf7fe2d2 service nova] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2c029db9-81c4-4850-be1b-17cfbd8d5ee3 req-156bb3be-02e7-477e-8f7e-2b29bf7fe2d2 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2c029db9-81c4-4850-be1b-17cfbd8d5ee3 req-156bb3be-02e7-477e-8f7e-2b29bf7fe2d2 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-2c029db9-81c4-4850-be1b-17cfbd8d5ee3 req-156bb3be-02e7-477e-8f7e-2b29bf7fe2d2 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] No waiting events found dispatching network-vif-unplugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:57:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-2c029db9-81c4-4850-be1b-17cfbd8d5ee3 req-156bb3be-02e7-477e-8f7e-2b29bf7fe2d2 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-vif-unplugged-47395266-6458-4699-96ce-7a0d176dc6ac for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG nova.network.neutron [req-c4a5fb99-30c5-4770-ac8e-b82565e28e17 req-fc15b2c0-9cd7-494e-b6a9-1fcec9ebe7e8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updated VIF entry in instance network info cache for port 47395266-6458-4699-96ce-7a0d176dc6ac. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG nova.network.neutron [req-c4a5fb99-30c5-4770-ac8e-b82565e28e17 req-fc15b2c0-9cd7-494e-b6a9-1fcec9ebe7e8 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updating instance_info_cache with network_info: [{"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c4a5fb99-30c5-4770-ac8e-b82565e28e17 req-fc15b2c0-9cd7-494e-b6a9-1fcec9ebe7e8 service nova] Releasing lock "refresh_cache-aa475371-4888-4c4b-9b74-4e813b804da6" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:57:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Instance destroyed successfully.
Aug 27 03:57:27 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lazy-loading 'resources' on Instance uuid aa475371-4888-4c4b-9b74-4e813b804da6 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1204888072',display_name='tempest-TestShelveInstance-server-1204888072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1204888072',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODV3Eri2dz2QHD+ZkoRXONy+eMUQH4dVucSwROfVAI7uHKjkcKJQ36vL0D2hVAPAob00hmgbkYOFlwA0UkWtUYMQOIanoWC+2Pla6BWL/YN26BBCZtlxP3wx1JEWrSQ/w==',key_name='tempest-TestShelveInstance-2100279265',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:55:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35b53f8f3359444bbc0ef845387a827a',ramdisk_id='',reservation_id='r-lglgy4lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1842874330',owner_user_name='tempest-TestShelveInstance-1842874330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:55:57Z,user_data=None,user_id='e2aa172fbf7844d390e285244a4f3799',uuid=aa475371-4888-4c4b-9b74-4e813b804da6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Converting VIF {"id": "47395266-6458-4699-96ce-7a0d176dc6ac", "address": "fa:16:3e:66:5d:2f", "network": {"id": "e7f8889b-b693-40b8-bccc-d5309676d2d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1588924308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35b53f8f3359444bbc0ef845387a827a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47395266-64", "ovs_interfaceid": "47395266-6458-4699-96ce-7a0d176dc6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_vif [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47395266-64, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:57:27 user nova-compute[72990]: INFO os_vif [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=47395266-6458-4699-96ce-7a0d176dc6ac,network=Network(e7f8889b-b693-40b8-bccc-d5309676d2d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47395266-64')
Aug 27 03:57:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcKDWLfy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:57:27 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da512f7-dd45-43ba-b057-985ccfdb5b37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e009c54f-ee96-4bf5-b794-275591f3eaf8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:57:27 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:57:27 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:57:27 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:57:27 user nova-compute[72990]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:57:27 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:57:27 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:57:27 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:57:27 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:57:27 user nova-compute[72990]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 (non-flash)
Aug 27 03:57:27 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f43d1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8475e1ee-cc1d-4a28-8842-dfdff1bdb1ee]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa130a0-48b1-4173-b235-0946647eb991]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0815c750-b94e-450e-b406-ed8e2dabb12d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92e25d6-a0b1-4dd2-a0ab-625682e932ff]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_aebf3555',) {{(pid=84652) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7212e153-a8ce-4e20-9d1a-98808569829e]: (4, None) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[740ec5be-add7-4b83-924c-8fa2b6fdb398]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b972d0-7554-4833-bc79-20fe97a3edc4]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260]
Aug 27 03:57:27 user nova-compute[72990]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083, portal: 172.16.0.220,3260] successful.
Aug 27 03:57:27 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9a333-ea9b-467b-9f8d-8579cc71b083 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cfe404-b4c0-4f73-a0cf-8c537dfc260b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] <== disconnect_volume: return (332ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:57:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Deleting instance files /opt/stack/data/nova/instances/aa475371-4888-4c4b-9b74-4e813b804da6_del
Aug 27 03:57:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Deletion of /opt/stack/data/nova/instances/aa475371-4888-4c4b-9b74-4e813b804da6_del complete
Aug 27 03:57:27 user nova-compute[72990]: INFO nova.compute.manager [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 27 03:57:27 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:57:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:28 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:57:28 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Took 1.13 seconds to deallocate network for instance.
Aug 27 03:57:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-1db8b93f-1798-4a4c-8ab8-6d76c3b4cfce req-bc93cf55-9c38-4303-8c59-c45b3cf51472 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-vif-deleted-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-8730495a-3ae0-445c-8da7-6ad0af7c8650 req-d0a8118e-47de-47ec-b054-73ad879c3c45 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received event network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8730495a-3ae0-445c-8da7-6ad0af7c8650 req-d0a8118e-47de-47ec-b054-73ad879c3c45 service nova] Acquiring lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8730495a-3ae0-445c-8da7-6ad0af7c8650 req-d0a8118e-47de-47ec-b054-73ad879c3c45 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8730495a-3ae0-445c-8da7-6ad0af7c8650 req-d0a8118e-47de-47ec-b054-73ad879c3c45 service nova] Lock "aa475371-4888-4c4b-9b74-4e813b804da6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-8730495a-3ae0-445c-8da7-6ad0af7c8650 req-d0a8118e-47de-47ec-b054-73ad879c3c45 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] No waiting events found dispatching network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:57:28 user nova-compute[72990]: WARNING nova.compute.manager [req-8730495a-3ae0-445c-8da7-6ad0af7c8650 req-d0a8118e-47de-47ec-b054-73ad879c3c45 service nova] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Received unexpected event network-vif-plugged-47395266-6458-4699-96ce-7a0d176dc6ac for instance with vm_state active and task_state deleting.
Aug 27 03:57:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:29 user nova-compute[72990]: INFO nova.compute.manager [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Terminating instance
Aug 27 03:57:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-3c11114d-1054-4318-a59e-e9919377c8aa req-07cfa6f2-1bc6-4923-8cb6-8c9b94843cb9 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-unplugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3c11114d-1054-4318-a59e-e9919377c8aa req-07cfa6f2-1bc6-4923-8cb6-8c9b94843cb9 service nova] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3c11114d-1054-4318-a59e-e9919377c8aa req-07cfa6f2-1bc6-4923-8cb6-8c9b94843cb9 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3c11114d-1054-4318-a59e-e9919377c8aa req-07cfa6f2-1bc6-4923-8cb6-8c9b94843cb9 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-3c11114d-1054-4318-a59e-e9919377c8aa req-07cfa6f2-1bc6-4923-8cb6-8c9b94843cb9 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] No waiting events found dispatching network-vif-unplugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-3c11114d-1054-4318-a59e-e9919377c8aa req-07cfa6f2-1bc6-4923-8cb6-8c9b94843cb9 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-unplugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:57:29 user nova-compute[72990]: INFO nova.compute.manager [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Took 0.91 seconds to detach 1 volumes for instance.
Aug 27 03:57:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Deleting volume: c9c9a333-ea9b-467b-9f8d-8579cc71b083 {{(pid=72990) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:57:30 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Instance destroyed successfully.
Aug 27 03:57:30 user nova-compute[72990]: DEBUG nova.objects.instance [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'resources' on Instance uuid 250288e9-5421-4757-9258-fa1cf0c3be2f {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-46726741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-46726741',id=26,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-mfhlhcbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:55:44Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=250288e9-5421-4757-9258-fa1cf0c3be2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "address": "fa:16:3e:81:0c:0f", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92099d9-a8", "ovs_interfaceid": "f92099d9-a8e3-45fa-879a-40a71a5ca301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=f92099d9-a8e3-45fa-879a-40a71a5ca301,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92099d9-a8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_vif [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=f92099d9-a8e3-45fa-879a-40a71a5ca301,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92099d9-a8') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf92099d9-a8, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:30 user nova-compute[72990]: INFO os_vif [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=f92099d9-a8e3-45fa-879a-40a71a5ca301,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92099d9-a8')
Aug 27 03:57:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMWzfXqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:57:30 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2a8ba8-040f-4a82-a505-66fffc958260]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:30 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Deleted allocations for instance aa475371-4888-4c4b-9b74-4e813b804da6
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca64c45-2c70-49c8-9e00-b73094a7ed04]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:57:30 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:57:30 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:57:30 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:57:30 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:57:30 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:57:30 user nova-compute[72990]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 (non-flash)
Aug 27 03:57:30 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:57:30 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4458af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212'): ({'sdh'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Removing single pathed devices sdh {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a5e879-f406-48f6-8f70-e4ad3d7794e9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e630cac-de10-4755-8625-e20531082712]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flushing IO for device /dev/sdh {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d12a0-ad9b-4fd7-887e-ca54abe7a6ec]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2b6e257f-875b-4cc5-80f9-701a24269073 tempest-TestShelveInstance-1842874330 tempest-TestShelveInstance-1842874330-project-member] Lock "aa475371-4888-4c4b-9b74-4e813b804da6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5d0884-e9b7-45be-81e1-4cbf2f438609]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] SCSI volumes sdh have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_83fdd4bb', '/dev/disk/by-id/scsi-1SCST_BIO83fdd4bb-00f8fbfe4e4bb464', '/dev/disk/by-id/scsi-23030663866626665') {{(pid=84652) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78d3271-0a56-4733-a984-e3874bc1398d]: (4, None) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1f08bb-e79c-4589-85d5-1753546f315c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c4de4a-ef49-47e2-8049-4a91fbd64c78]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212, portal: 172.16.0.220,3260]
Aug 27 03:57:30 user nova-compute[72990]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212, portal: 172.16.0.220,3260] successful.
Aug 27 03:57:30 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abacf48-09ce-40ba-8934-9b6d50bfe212 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c1dcc6-181f-4ff3-914e-922f785846f8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] <== disconnect_volume: return (355ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:57:30 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Deleting instance files /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f_del
Aug 27 03:57:30 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Deletion of /opt/stack/data/nova/instances/250288e9-5421-4757-9258-fa1cf0c3be2f_del complete
Aug 27 03:57:30 user nova-compute[72990]: INFO nova.compute.manager [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 27 03:57:30 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:57:30 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:57:31 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:57:31 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:57:31 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Took 0.88 seconds to deallocate network for instance.
Aug 27 03:57:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-0d449c01-f63c-419c-a6ab-de01652e5628 req-c2cc656e-578d-4858-9f6f-e4ddaccedf77 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-deleted-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:31 user nova-compute[72990]: INFO nova.compute.manager [req-0d449c01-f63c-419c-a6ab-de01652e5628 req-c2cc656e-578d-4858-9f6f-e4ddaccedf77 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Neutron deleted interface f92099d9-a8e3-45fa-879a-40a71a5ca301; detaching it from the instance and deleting it from the info cache
Aug 27 03:57:31 user nova-compute[72990]: DEBUG nova.network.neutron [req-0d449c01-f63c-419c-a6ab-de01652e5628 req-c2cc656e-578d-4858-9f6f-e4ddaccedf77 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:57:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-0d449c01-f63c-419c-a6ab-de01652e5628 req-c2cc656e-578d-4858-9f6f-e4ddaccedf77 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Detach interface failed, port_id=f92099d9-a8e3-45fa-879a-40a71a5ca301, reason: Instance 250288e9-5421-4757-9258-fa1cf0c3be2f could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:57:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-bb4bb433-d4fb-4e45-a50f-02cc64ee13c8 req-8bf6c1e6-fb1b-474d-9746-ac7cce2e9e42 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bb4bb433-d4fb-4e45-a50f-02cc64ee13c8 req-8bf6c1e6-fb1b-474d-9746-ac7cce2e9e42 service nova] Acquiring lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bb4bb433-d4fb-4e45-a50f-02cc64ee13c8 req-8bf6c1e6-fb1b-474d-9746-ac7cce2e9e42 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bb4bb433-d4fb-4e45-a50f-02cc64ee13c8 req-8bf6c1e6-fb1b-474d-9746-ac7cce2e9e42 service nova] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-bb4bb433-d4fb-4e45-a50f-02cc64ee13c8 req-8bf6c1e6-fb1b-474d-9746-ac7cce2e9e42 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] No waiting events found dispatching network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:57:31 user nova-compute[72990]: WARNING nova.compute.manager [req-bb4bb433-d4fb-4e45-a50f-02cc64ee13c8 req-8bf6c1e6-fb1b-474d-9746-ac7cce2e9e42 service nova] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Received unexpected event network-vif-plugged-f92099d9-a8e3-45fa-879a-40a71a5ca301 for instance with vm_state active and task_state deleting.
Aug 27 03:57:32 user nova-compute[72990]: INFO nova.compute.manager [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Took 0.80 seconds to detach 1 volumes for instance.
Aug 27 03:57:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:32 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:57:32 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:57:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:32 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Deleted allocations for instance 250288e9-5421-4757-9258-fa1cf0c3be2f
Aug 27 03:57:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fd9c6d33-8a62-430e-a3c9-9444c3ae0a7e tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "250288e9-5421-4757-9258-fa1cf0c3be2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.559s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:33 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:57:33 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:57:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:57:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:34 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:57:34 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:57:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:57:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:35 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:57:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:38 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:57:38 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=24.94756317138672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ca203604-996d-4558-9857-df9e2001c319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 6a44010b-9a96-4343-a35c-1f212d21e47b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance d4f94cba-21ec-42a8-babc-859becde2c82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 0c38f974-36a1-49d3-8749-f6637ddbe6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.485s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:57:38 user nova-compute[72990]: INFO nova.compute.claims [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Claim successful on node user
Aug 27 03:57:39 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:57:39 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:57:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG nova.policy [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a576f0801b5e4b42bb58357d30a76ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7981033f574199afbe602b19b81001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:57:39 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Creating image(s)
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "/opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "/opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.169s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk 1073741824" returned: 0 in 0.062s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:57:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Cannot resize image /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Ensure instance console log exists: /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG nova.network.neutron [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Successfully created port: 52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:57:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Successfully updated port: 52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "refresh_cache-0ac97670-dd82-4e3f-b34c-5d9be0e36501" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquired lock "refresh_cache-0ac97670-dd82-4e3f-b34c-5d9be0e36501" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-07962fae-e1e2-458c-94d0-3a5fc512f883 req-d529163f-fb01-4015-9773-d74eaf6bd454 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Received event network-changed-52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-07962fae-e1e2-458c-94d0-3a5fc512f883 req-d529163f-fb01-4015-9773-d74eaf6bd454 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Refreshing instance network info cache due to event network-changed-52696cfb-708d-41ac-9594-1591bc9df14c. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-07962fae-e1e2-458c-94d0-3a5fc512f883 req-d529163f-fb01-4015-9773-d74eaf6bd454 service nova] Acquiring lock "refresh_cache-0ac97670-dd82-4e3f-b34c-5d9be0e36501" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Updating instance_info_cache with network_info: [{"id": "52696cfb-708d-41ac-9594-1591bc9df14c", "address": "fa:16:3e:f2:39:80", "network": {"id": "305f13a8-b1fe-4352-8ddb-457758bf97f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2115229939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d7981033f574199afbe602b19b81001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52696cfb-70", "ovs_interfaceid": "52696cfb-708d-41ac-9594-1591bc9df14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Releasing lock "refresh_cache-0ac97670-dd82-4e3f-b34c-5d9be0e36501" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Instance network_info: |[{"id": "52696cfb-708d-41ac-9594-1591bc9df14c", "address": "fa:16:3e:f2:39:80", "network": {"id": "305f13a8-b1fe-4352-8ddb-457758bf97f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2115229939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d7981033f574199afbe602b19b81001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52696cfb-70", "ovs_interfaceid": "52696cfb-708d-41ac-9594-1591bc9df14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-07962fae-e1e2-458c-94d0-3a5fc512f883 req-d529163f-fb01-4015-9773-d74eaf6bd454 service nova] Acquired lock "refresh_cache-0ac97670-dd82-4e3f-b34c-5d9be0e36501" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.network.neutron [req-07962fae-e1e2-458c-94d0-3a5fc512f883 req-d529163f-fb01-4015-9773-d74eaf6bd454 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Refreshing network info cache for port 52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Start _get_guest_xml network_info=[{"id": "52696cfb-708d-41ac-9594-1591bc9df14c", "address": "fa:16:3e:f2:39:80", "network": {"id": "305f13a8-b1fe-4352-8ddb-457758bf97f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2115229939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d7981033f574199afbe602b19b81001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52696cfb-70", "ovs_interfaceid": "52696cfb-708d-41ac-9594-1591bc9df14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:57:41 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:57:41 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-348699316',display_name='tempest-TestServerVolumeAttachmentScenario-server-348699316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-348699316',id=31,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHB/HO6v0usJFTMl/+STMvOTQqnRVPtJd6JpPWstffTZJjmKOp6z8zts6TaVpLktO4j/MsDmSsK/QSo1fQTe2mq/yYA5eOTxJuPs922CfrDxGTudouNmQGpPqKAlFAYcQ==',key_name='tempest-keypair-1973740565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d7981033f574199afbe602b19b81001',ramdisk_id='',reservation_id='r-dv5z0okc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1613470576',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1613470576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a576f0801b5e4b42bb58357d30a76ab7',uuid=0ac97670-dd82-4e3f-b34c-5d9be0e36501,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52696cfb-708d-41ac-9594-1591bc9df14c", "address": "fa:16:3e:f2:39:80", "network": {"id": "305f13a8-b1fe-4352-8ddb-457758bf97f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2115229939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d7981033f574199afbe602b19b81001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52696cfb-70", "ovs_interfaceid": "52696cfb-708d-41ac-9594-1591bc9df14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Converting VIF {"id": "52696cfb-708d-41ac-9594-1591bc9df14c", "address": "fa:16:3e:f2:39:80", "network": {"id": "305f13a8-b1fe-4352-8ddb-457758bf97f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2115229939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d7981033f574199afbe602b19b81001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52696cfb-70", "ovs_interfaceid": "52696cfb-708d-41ac-9594-1591bc9df14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:39:80,bridge_name='br-int',has_traffic_filtering=True,id=52696cfb-708d-41ac-9594-1591bc9df14c,network=Network(305f13a8-b1fe-4352-8ddb-457758bf97f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52696cfb-70') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.objects.instance [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ac97670-dd82-4e3f-b34c-5d9be0e36501 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:57:41 user nova-compute[72990]:   <uuid>0ac97670-dd82-4e3f-b34c-5d9be0e36501</uuid>
Aug 27 03:57:41 user nova-compute[72990]:   <name>instance-0000001f</name>
Aug 27 03:57:41 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:57:41 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:57:41 user nova-compute[72990]:   <metadata>
Aug 27 03:57:41 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:57:41 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:57:41 user nova-compute[72990]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-348699316</nova:name>
Aug 27 03:57:41 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:57:41</nova:creationTime>
Aug 27 03:57:41 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:57:41 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:57:41 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:57:41 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:57:41 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:57:41 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:57:41 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:57:41 user nova-compute[72990]:       <nova:owner>
Aug 27 03:57:41 user nova-compute[72990]:         <nova:user uuid="a576f0801b5e4b42bb58357d30a76ab7">tempest-TestServerVolumeAttachmentScenario-1613470576-project-member</nova:user>
Aug 27 03:57:41 user nova-compute[72990]:         <nova:project uuid="1d7981033f574199afbe602b19b81001">tempest-TestServerVolumeAttachmentScenario-1613470576</nova:project>
Aug 27 03:57:41 user nova-compute[72990]:       </nova:owner>
Aug 27 03:57:41 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:57:41 user nova-compute[72990]:       <nova:ports>
Aug 27 03:57:41 user nova-compute[72990]:         <nova:port uuid="52696cfb-708d-41ac-9594-1591bc9df14c">
Aug 27 03:57:41 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 03:57:41 user nova-compute[72990]:         </nova:port>
Aug 27 03:57:41 user nova-compute[72990]:       </nova:ports>
Aug 27 03:57:41 user nova-compute[72990]:     </nova:instance>
Aug 27 03:57:41 user nova-compute[72990]:   </metadata>
Aug 27 03:57:41 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:57:41 user nova-compute[72990]:     <system>
Aug 27 03:57:41 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:57:41 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:57:41 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:57:41 user nova-compute[72990]:       <entry name="serial">0ac97670-dd82-4e3f-b34c-5d9be0e36501</entry>
Aug 27 03:57:41 user nova-compute[72990]:       <entry name="uuid">0ac97670-dd82-4e3f-b34c-5d9be0e36501</entry>
Aug 27 03:57:41 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:57:41 user nova-compute[72990]:     </system>
Aug 27 03:57:41 user nova-compute[72990]:   </sysinfo>
Aug 27 03:57:41 user nova-compute[72990]:   <os>
Aug 27 03:57:41 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:57:41 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:57:41 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:57:41 user nova-compute[72990]:   </os>
Aug 27 03:57:41 user nova-compute[72990]:   <features>
Aug 27 03:57:41 user nova-compute[72990]:     <acpi/>
Aug 27 03:57:41 user nova-compute[72990]:     <apic/>
Aug 27 03:57:41 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:57:41 user nova-compute[72990]:   </features>
Aug 27 03:57:41 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:57:41 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:57:41 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:57:41 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:57:41 user nova-compute[72990]:   </clock>
Aug 27 03:57:41 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:57:41 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:57:41 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:57:41 user nova-compute[72990]:   </cpu>
Aug 27 03:57:41 user nova-compute[72990]:   <devices>
Aug 27 03:57:41 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:57:41 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:57:41 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk"/>
Aug 27 03:57:41 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:57:41 user nova-compute[72990]:     </disk>
Aug 27 03:57:41 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:57:41 user nova-compute[72990]:       <mac address="fa:16:3e:f2:39:80"/>
Aug 27 03:57:41 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:57:41 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:57:41 user nova-compute[72990]:       <target dev="tap52696cfb-70"/>
Aug 27 03:57:41 user nova-compute[72990]:     </interface>
Aug 27 03:57:41 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:57:41 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/console.log" append="off"/>
Aug 27 03:57:41 user nova-compute[72990]:     </serial>
Aug 27 03:57:41 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:57:41 user nova-compute[72990]:     <video>
Aug 27 03:57:41 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:57:41 user nova-compute[72990]:     </video>
Aug 27 03:57:41 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:57:41 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:57:41 user nova-compute[72990]:     </rng>
Aug 27 03:57:41 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:57:41 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:57:41 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:57:41 user nova-compute[72990]:     </memballoon>
Aug 27 03:57:41 user nova-compute[72990]:   </devices>
Aug 27 03:57:41 user nova-compute[72990]: </domain>
Aug 27 03:57:41 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-348699316',display_name='tempest-TestServerVolumeAttachmentScenario-server-348699316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-348699316',id=31,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHB/HO6v0usJFTMl/+STMvOTQqnRVPtJd6JpPWstffTZJjmKOp6z8zts6TaVpLktO4j/MsDmSsK/QSo1fQTe2mq/yYA5eOTxJuPs922CfrDxGTudouNmQGpPqKAlFAYcQ==',key_name='tempest-keypair-1973740565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d7981033f574199afbe602b19b81001',ramdisk_id='',reservation_id='r-dv5z0okc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1613470576',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1613470576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a576f0801b5e4b42bb58357d30a76ab7',uuid=0ac97670-dd82-4e3f-b34c-5d9be0e36501,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52696cfb-708d-41ac-9594-1591bc9df14c", "address": "fa:16:3e:f2:39:80", "network": {"id": "305f13a8-b1fe-4352-8ddb-457758bf97f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2115229939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d7981033f574199afbe602b19b81001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52696cfb-70", "ovs_interfaceid": "52696cfb-708d-41ac-9594-1591bc9df14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Converting VIF {"id": "52696cfb-708d-41ac-9594-1591bc9df14c", "address": "fa:16:3e:f2:39:80", "network": {"id": "305f13a8-b1fe-4352-8ddb-457758bf97f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2115229939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d7981033f574199afbe602b19b81001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52696cfb-70", "ovs_interfaceid": "52696cfb-708d-41ac-9594-1591bc9df14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:39:80,bridge_name='br-int',has_traffic_filtering=True,id=52696cfb-708d-41ac-9594-1591bc9df14c,network=Network(305f13a8-b1fe-4352-8ddb-457758bf97f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52696cfb-70') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG os_vif [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:39:80,bridge_name='br-int',has_traffic_filtering=True,id=52696cfb-708d-41ac-9594-1591bc9df14c,network=Network(305f13a8-b1fe-4352-8ddb-457758bf97f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52696cfb-70') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52696cfb-70, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52696cfb-70, col_values=(('external_ids', {'iface-id': '52696cfb-708d-41ac-9594-1591bc9df14c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:39:80', 'vm-uuid': '0ac97670-dd82-4e3f-b34c-5d9be0e36501'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:41 user nova-compute[72990]: INFO os_vif [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:39:80,bridge_name='br-int',has_traffic_filtering=True,id=52696cfb-708d-41ac-9594-1591bc9df14c,network=Network(305f13a8-b1fe-4352-8ddb-457758bf97f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52696cfb-70')
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:57:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] No VIF found with MAC fa:16:3e:f2:39:80, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:57:42 user nova-compute[72990]: DEBUG nova.network.neutron [req-07962fae-e1e2-458c-94d0-3a5fc512f883 req-d529163f-fb01-4015-9773-d74eaf6bd454 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Updated VIF entry in instance network info cache for port 52696cfb-708d-41ac-9594-1591bc9df14c. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:57:42 user nova-compute[72990]: DEBUG nova.network.neutron [req-07962fae-e1e2-458c-94d0-3a5fc512f883 req-d529163f-fb01-4015-9773-d74eaf6bd454 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Updating instance_info_cache with network_info: [{"id": "52696cfb-708d-41ac-9594-1591bc9df14c", "address": "fa:16:3e:f2:39:80", "network": {"id": "305f13a8-b1fe-4352-8ddb-457758bf97f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2115229939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d7981033f574199afbe602b19b81001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52696cfb-70", "ovs_interfaceid": "52696cfb-708d-41ac-9594-1591bc9df14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:57:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-07962fae-e1e2-458c-94d0-3a5fc512f883 req-d529163f-fb01-4015-9773-d74eaf6bd454 service nova] Releasing lock "refresh_cache-0ac97670-dd82-4e3f-b34c-5d9be0e36501" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:57:42 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108647.3169518, aa475371-4888-4c4b-9b74-4e813b804da6 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:57:42 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] VM Stopped (Lifecycle Event)
Aug 27 03:57:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-42e31217-97ba-4eae-9c2b-f42e3c950d43 None None] [instance: aa475371-4888-4c4b-9b74-4e813b804da6] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:57:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-bf5049ac-5e62-4363-bb48-03332dd74511 req-8ea46741-5924-4bc7-8f1b-64051233dc70 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Received event network-vif-plugged-52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bf5049ac-5e62-4363-bb48-03332dd74511 req-8ea46741-5924-4bc7-8f1b-64051233dc70 service nova] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bf5049ac-5e62-4363-bb48-03332dd74511 req-8ea46741-5924-4bc7-8f1b-64051233dc70 service nova] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bf5049ac-5e62-4363-bb48-03332dd74511 req-8ea46741-5924-4bc7-8f1b-64051233dc70 service nova] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-bf5049ac-5e62-4363-bb48-03332dd74511 req-8ea46741-5924-4bc7-8f1b-64051233dc70 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] No waiting events found dispatching network-vif-plugged-52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:57:43 user nova-compute[72990]: WARNING nova.compute.manager [req-bf5049ac-5e62-4363-bb48-03332dd74511 req-8ea46741-5924-4bc7-8f1b-64051233dc70 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Received unexpected event network-vif-plugged-52696cfb-708d-41ac-9594-1591bc9df14c for instance with vm_state building and task_state spawning.
Aug 27 03:57:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ca203604-996d-4558-9857-df9e2001c319" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:45 user nova-compute[72990]: INFO nova.compute.manager [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Terminating instance
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108665.287957, 0ac97670-dd82-4e3f-b34c-5d9be0e36501 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:57:45 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] VM Resumed (Lifecycle Event)
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108650.297781, 250288e9-5421-4757-9258-fa1cf0c3be2f => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:57:45 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] VM Stopped (Lifecycle Event)
Aug 27 03:57:45 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Instance spawned successfully.
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-0a8f2f40-078f-4704-a852-a301897c63f5 None None] [instance: 250288e9-5421-4757-9258-fa1cf0c3be2f] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:57:45 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108665.291224, 0ac97670-dd82-4e3f-b34c-5d9be0e36501 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:57:45 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] VM Started (Lifecycle Event)
Aug 27 03:57:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:45 user nova-compute[72990]: INFO nova.compute.manager [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:57:45 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:57:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-4bc11478-aaf8-4305-a24a-7a5848beb5dd req-0c44fcf0-1771-405d-a8ff-010ecd6331f6 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Received event network-vif-plugged-52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4bc11478-aaf8-4305-a24a-7a5848beb5dd req-0c44fcf0-1771-405d-a8ff-010ecd6331f6 service nova] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4bc11478-aaf8-4305-a24a-7a5848beb5dd req-0c44fcf0-1771-405d-a8ff-010ecd6331f6 service nova] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4bc11478-aaf8-4305-a24a-7a5848beb5dd req-0c44fcf0-1771-405d-a8ff-010ecd6331f6 service nova] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-4bc11478-aaf8-4305-a24a-7a5848beb5dd req-0c44fcf0-1771-405d-a8ff-010ecd6331f6 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] No waiting events found dispatching network-vif-plugged-52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:57:45 user nova-compute[72990]: WARNING nova.compute.manager [req-4bc11478-aaf8-4305-a24a-7a5848beb5dd req-0c44fcf0-1771-405d-a8ff-010ecd6331f6 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Received unexpected event network-vif-plugged-52696cfb-708d-41ac-9594-1591bc9df14c for instance with vm_state building and task_state spawning.
Aug 27 03:57:45 user nova-compute[72990]: INFO nova.compute.manager [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Took 7.39 seconds to build instance.
Aug 27 03:57:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-118923d9-a227-43f2-a1d9-a6acbc462d1e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.975s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:46 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: ca203604-996d-4558-9857-df9e2001c319] Instance destroyed successfully.
Aug 27 03:57:46 user nova-compute[72990]: DEBUG nova.objects.instance [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lazy-loading 'resources' on Instance uuid ca203604-996d-4558-9857-df9e2001c319 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1768289849',display_name='tempest-ServerRescueNegativeTestJSON-server-1768289849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1768289849',id=1,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:45:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='567ed48c72c547c6984851d6ba37e780',ramdisk_id='',reservation_id='r-nlz0jlc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-311406621',owner_user_name='tempest-ServerRescueNegativeTestJSON-311406621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:47:11Z,user_data=None,user_id='f0631ab8ad8648e2912d4e554fbbe195',uuid=ca203604-996d-4558-9857-df9e2001c319,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converting VIF {"id": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "address": "fa:16:3e:3c:66:7d", "network": {"id": "7e7ff840-9662-4b10-a437-54e462d675d2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-172407474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567ed48c72c547c6984851d6ba37e780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap372aa0cf-2e", "ovs_interfaceid": "372aa0cf-2e3f-47db-a433-7ed673f37dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:66:7d,bridge_name='br-int',has_traffic_filtering=True,id=372aa0cf-2e3f-47db-a433-7ed673f37dd0,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372aa0cf-2e') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG os_vif [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:66:7d,bridge_name='br-int',has_traffic_filtering=True,id=372aa0cf-2e3f-47db-a433-7ed673f37dd0,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372aa0cf-2e') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap372aa0cf-2e, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:57:46 user nova-compute[72990]: INFO os_vif [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:66:7d,bridge_name='br-int',has_traffic_filtering=True,id=372aa0cf-2e3f-47db-a433-7ed673f37dd0,network=Network(7e7ff840-9662-4b10-a437-54e462d675d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap372aa0cf-2e')
Aug 27 03:57:46 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Deleting instance files /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319_del
Aug 27 03:57:46 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Deletion of /opt/stack/data/nova/instances/ca203604-996d-4558-9857-df9e2001c319_del complete
Aug 27 03:57:46 user nova-compute[72990]: INFO nova.compute.manager [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] [instance: ca203604-996d-4558-9857-df9e2001c319] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 27 03:57:46 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: ca203604-996d-4558-9857-df9e2001c319] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: ca203604-996d-4558-9857-df9e2001c319] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:46 user nova-compute[72990]: INFO nova.compute.manager [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Terminating instance
Aug 27 03:57:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: ca203604-996d-4558-9857-df9e2001c319] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:57:46 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: ca203604-996d-4558-9857-df9e2001c319] Took 0.63 seconds to deallocate network for instance.
Aug 27 03:57:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-477ae307-0e85-4eb1-b5bc-0eaef4bfb54e req-aa26d503-dd61-407f-8db8-b5f7bc2c56d4 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-deleted-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:46 user nova-compute[72990]: INFO nova.compute.manager [req-477ae307-0e85-4eb1-b5bc-0eaef4bfb54e req-aa26d503-dd61-407f-8db8-b5f7bc2c56d4 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Neutron deleted interface 372aa0cf-2e3f-47db-a433-7ed673f37dd0; detaching it from the instance and deleting it from the info cache
Aug 27 03:57:46 user nova-compute[72990]: DEBUG nova.network.neutron [req-477ae307-0e85-4eb1-b5bc-0eaef4bfb54e req-aa26d503-dd61-407f-8db8-b5f7bc2c56d4 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-477ae307-0e85-4eb1-b5bc-0eaef4bfb54e req-aa26d503-dd61-407f-8db8-b5f7bc2c56d4 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Detach interface failed, port_id=372aa0cf-2e3f-47db-a433-7ed673f37dd0, reason: Instance ca203604-996d-4558-9857-df9e2001c319 could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:47 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Deleted allocations for instance ca203604-996d-4558-9857-df9e2001c319
Aug 27 03:57:47 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Instance destroyed successfully.
Aug 27 03:57:47 user nova-compute[72990]: DEBUG nova.objects.instance [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lazy-loading 'resources' on Instance uuid f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T03:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-886886887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-886886887',id=27,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb4gesZwfxCDTM0W9aM+C7He0/Aub6UyHKYOgf/t95RKC8+hn/x/f9jOtmOwHySm1O9Cjsn9zMaKpYpEKkII5kNwunF1+RbMLEgByZl4DzqWanUzIfy5QW0JU1Qa09bcg==',key_name='tempest-keypair-631728363',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd44d92dded643eb89d955dbf6b4d1e3',ramdisk_id='',reservation_id='r-nh5nv47v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2085503517',owner_user_name='tempest-AttachVolumeShelveTestJSON-2085503517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be8e872f1de4248a557155ff1c4f5ec',uuid=f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converting VIF {"id": "778be9fb-ea44-464a-b5a7-aea387c1aded", "address": "fa:16:3e:1f:dd:13", "network": {"id": "22125966-78fc-4866-94dc-f629d1397beb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1616463009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd44d92dded643eb89d955dbf6b4d1e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778be9fb-ea", "ovs_interfaceid": "778be9fb-ea44-464a-b5a7-aea387c1aded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG os_vif [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap778be9fb-ea, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:47 user nova-compute[72990]: INFO os_vif [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=778be9fb-ea44-464a-b5a7-aea387c1aded,network=Network(22125966-78fc-4866-94dc-f629d1397beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778be9fb-ea')
Aug 27 03:57:47 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Deleting instance files /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d_del
Aug 27 03:57:47 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Deletion of /opt/stack/data/nova/instances/f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d_del complete
Aug 27 03:57:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ee630d14-5966-4b3e-9b4f-4bfcfc82ebfd tempest-ServerRescueNegativeTestJSON-311406621 tempest-ServerRescueNegativeTestJSON-311406621-project-member] Lock "ca203604-996d-4558-9857-df9e2001c319" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.163s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:47 user nova-compute[72990]: INFO nova.compute.manager [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 27 03:57:47 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-278467c4-7d24-4f44-af60-905592ca2843 req-f291a7ea-6629-4043-93b2-fb966d177d55 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-unplugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-278467c4-7d24-4f44-af60-905592ca2843 req-f291a7ea-6629-4043-93b2-fb966d177d55 service nova] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-278467c4-7d24-4f44-af60-905592ca2843 req-f291a7ea-6629-4043-93b2-fb966d177d55 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-278467c4-7d24-4f44-af60-905592ca2843 req-f291a7ea-6629-4043-93b2-fb966d177d55 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-278467c4-7d24-4f44-af60-905592ca2843 req-f291a7ea-6629-4043-93b2-fb966d177d55 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] No waiting events found dispatching network-vif-unplugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:57:47 user nova-compute[72990]: WARNING nova.compute.manager [req-278467c4-7d24-4f44-af60-905592ca2843 req-f291a7ea-6629-4043-93b2-fb966d177d55 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received unexpected event network-vif-unplugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 for instance with vm_state deleted and task_state None.
Aug 27 03:57:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-278467c4-7d24-4f44-af60-905592ca2843 req-f291a7ea-6629-4043-93b2-fb966d177d55 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-278467c4-7d24-4f44-af60-905592ca2843 req-f291a7ea-6629-4043-93b2-fb966d177d55 service nova] Acquiring lock "ca203604-996d-4558-9857-df9e2001c319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-278467c4-7d24-4f44-af60-905592ca2843 req-f291a7ea-6629-4043-93b2-fb966d177d55 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-278467c4-7d24-4f44-af60-905592ca2843 req-f291a7ea-6629-4043-93b2-fb966d177d55 service nova] Lock "ca203604-996d-4558-9857-df9e2001c319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:47 user nova-compute[72990]: DEBUG nova.compute.manager [req-278467c4-7d24-4f44-af60-905592ca2843 req-f291a7ea-6629-4043-93b2-fb966d177d55 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] No waiting events found dispatching network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:57:47 user nova-compute[72990]: WARNING nova.compute.manager [req-278467c4-7d24-4f44-af60-905592ca2843 req-f291a7ea-6629-4043-93b2-fb966d177d55 service nova] [instance: ca203604-996d-4558-9857-df9e2001c319] Received unexpected event network-vif-plugged-372aa0cf-2e3f-47db-a433-7ed673f37dd0 for instance with vm_state deleted and task_state None.
Aug 27 03:57:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:57:48 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Took 1.07 seconds to deallocate network for instance.
Aug 27 03:57:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-vif-unplugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] No waiting events found dispatching network-vif-unplugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:57:48 user nova-compute[72990]: WARNING nova.compute.manager [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received unexpected event network-vif-unplugged-778be9fb-ea44-464a-b5a7-aea387c1aded for instance with vm_state deleted and task_state None.
Aug 27 03:57:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] Acquiring lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] No waiting events found dispatching network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:57:48 user nova-compute[72990]: WARNING nova.compute.manager [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received unexpected event network-vif-plugged-778be9fb-ea44-464a-b5a7-aea387c1aded for instance with vm_state deleted and task_state None.
Aug 27 03:57:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-ce1e1fec-774c-429b-b2be-20486ecbd92c req-9934aa0f-e425-4c60-8597-eec5da3713a8 service nova] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Received event network-vif-deleted-778be9fb-ea44-464a-b5a7-aea387c1aded {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:57:48 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:57:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:49 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Deleted allocations for instance f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d
Aug 27 03:57:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b27f0111-89a9-43b1-8293-f9a7f4fec52b tempest-AttachVolumeShelveTestJSON-2085503517 tempest-AttachVolumeShelveTestJSON-2085503517-project-member] Lock "f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.609s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:57:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:57:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:57:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:01 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108666.0630646, ca203604-996d-4558-9857-df9e2001c319 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:58:01 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: ca203604-996d-4558-9857-df9e2001c319] VM Stopped (Lifecycle Event)
Aug 27 03:58:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3b782e78-cdcb-4f5a-898b-469fbf45fc00 None None] [instance: ca203604-996d-4558-9857-df9e2001c319] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:58:02 user nova-compute[72990]: INFO nova.compute.manager [None req-a55d5ada-0e8c-4dae-b036-c557aba13440 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Get console output
Aug 27 03:58:02 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108667.3378973, f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:58:02 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] VM Stopped (Lifecycle Event)
Aug 27 03:58:02 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f7599fbc-12fa-4a70-b116-c4b8c2b69d7f None None] [instance: f1c3c1ca-2441-4b9c-aaf6-b1f03ffa628d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:58:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:02 user nova-compute[72990]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 27 03:58:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:58:20 user nova-compute[72990]: INFO nova.compute.claims [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Claim successful on node user
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "6a44010b-9a96-4343-a35c-1f212d21e47b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:20 user nova-compute[72990]: INFO nova.compute.manager [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Terminating instance
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.network.neutron [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:58:20 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:58:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:58:20 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Creating image(s)
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "/opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "/opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "/opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.compute.manager [req-dded119a-dc97-4c88-8b76-c1577a31a4bc req-923315da-9476-4b4f-845c-d3c3dfe6bb0a service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Received event network-vif-unplugged-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dded119a-dc97-4c88-8b76-c1577a31a4bc req-923315da-9476-4b4f-845c-d3c3dfe6bb0a service nova] Acquiring lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dded119a-dc97-4c88-8b76-c1577a31a4bc req-923315da-9476-4b4f-845c-d3c3dfe6bb0a service nova] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dded119a-dc97-4c88-8b76-c1577a31a4bc req-923315da-9476-4b4f-845c-d3c3dfe6bb0a service nova] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.compute.manager [req-dded119a-dc97-4c88-8b76-c1577a31a4bc req-923315da-9476-4b4f-845c-d3c3dfe6bb0a service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] No waiting events found dispatching network-vif-unplugged-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.compute.manager [req-dded119a-dc97-4c88-8b76-c1577a31a4bc req-923315da-9476-4b4f-845c-d3c3dfe6bb0a service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Received event network-vif-unplugged-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG nova.policy [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5711f5c9c8344de79b246e7eb8661ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a8267a0042a0ad831e7b91889dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.199s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk 1073741824" returned: 0 in 0.048s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:21 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Instance destroyed successfully.
Aug 27 03:58:21 user nova-compute[72990]: DEBUG nova.objects.instance [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'resources' on Instance uuid 6a44010b-9a96-4343-a35c-1f212d21e47b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-369566994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-369566994',id=21,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-ghwz9fkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:50:54Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=6a44010b-9a96-4343-a35c-1f212d21e47b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "address": "fa:16:3e:06:ff:f9", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9650c4a-cc", "ovs_interfaceid": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "address": "fa:16:3e:06:ff:f9", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9650c4a-cc", "ovs_interfaceid": "d9650c4a-ccab-4a6a-8eff-d0dc24651e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:f9,bridge_name='br-int',has_traffic_filtering=True,id=d9650c4a-ccab-4a6a-8eff-d0dc24651e6b,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9650c4a-cc') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG os_vif [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:f9,bridge_name='br-int',has_traffic_filtering=True,id=d9650c4a-ccab-4a6a-8eff-d0dc24651e6b,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9650c4a-cc') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9650c4a-cc, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:58:21 user nova-compute[72990]: INFO os_vif [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ff:f9,bridge_name='br-int',has_traffic_filtering=True,id=d9650c4a-ccab-4a6a-8eff-d0dc24651e6b,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9650c4a-cc')
Aug 27 03:58:21 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Deleting instance files /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b_del
Aug 27 03:58:21 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Deletion of /opt/stack/data/nova/instances/6a44010b-9a96-4343-a35c-1f212d21e47b_del complete
Aug 27 03:58:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.173s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:21 user nova-compute[72990]: INFO nova.compute.manager [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 27 03:58:21 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Cannot resize image /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Ensure instance console log exists: /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:21 user nova-compute[72990]: DEBUG nova.network.neutron [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Successfully created port: 35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:58:22 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Took 0.72 seconds to deallocate network for instance.
Aug 27 03:58:22 user nova-compute[72990]: DEBUG nova.compute.manager [req-c4b071fc-7fdb-407d-8d56-e3aeab5c8525 req-3aaed694-8a32-48e5-bbfa-2b28eb857404 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Received event network-vif-deleted-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:22 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Deleted allocations for instance 6a44010b-9a96-4343-a35c-1f212d21e47b
Aug 27 03:58:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Successfully updated port: 35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquired lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-752349ab-4cb7-42e2-8172-f42bb522c446 tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.192s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG nova.compute.manager [req-46498996-a537-4a52-9f2d-52fb81fc8519 req-d37112e9-1e41-4487-b457-1b6f77296225 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Received event network-vif-plugged-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-46498996-a537-4a52-9f2d-52fb81fc8519 req-d37112e9-1e41-4487-b457-1b6f77296225 service nova] Acquiring lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-46498996-a537-4a52-9f2d-52fb81fc8519 req-d37112e9-1e41-4487-b457-1b6f77296225 service nova] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-46498996-a537-4a52-9f2d-52fb81fc8519 req-d37112e9-1e41-4487-b457-1b6f77296225 service nova] Lock "6a44010b-9a96-4343-a35c-1f212d21e47b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:22 user nova-compute[72990]: DEBUG nova.compute.manager [req-46498996-a537-4a52-9f2d-52fb81fc8519 req-d37112e9-1e41-4487-b457-1b6f77296225 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] No waiting events found dispatching network-vif-plugged-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:58:22 user nova-compute[72990]: WARNING nova.compute.manager [req-46498996-a537-4a52-9f2d-52fb81fc8519 req-d37112e9-1e41-4487-b457-1b6f77296225 service nova] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Received unexpected event network-vif-plugged-d9650c4a-ccab-4a6a-8eff-d0dc24651e6b for instance with vm_state deleted and task_state None.
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updating instance_info_cache with network_info: [{"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Releasing lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance network_info: |[{"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Start _get_guest_xml network_info=[{"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:58:23 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:58:23 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1823636413',display_name='tempest-AttachVolumeTestJSON-server-1823636413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1823636413',id=32,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZNGdZSsfPtAguFJDKN3iVgvVi0aLXdyqROhiDmpQVPMLbPrj6LNqo6zh2eRkFzKq35WCkDJ3pahxf33JmxUgZuGyUraQp1NA3CDVXGmGeP0bYPK2BVWcRuq13QnqVJqg==',key_name='tempest-keypair-1602283704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d0a8267a0042a0ad831e7b91889dc7',ramdisk_id='',reservation_id='r-2qv66d4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-698620353',owner_user_name='tempest-AttachVolumeTestJSON-698620353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5711f5c9c8344de79b246e7eb8661ff2',uuid=aef3be9a-fd69-4428-97c3-1016d97ca0e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converting VIF {"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.objects.instance [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'pci_devices' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:58:23 user nova-compute[72990]:   <uuid>aef3be9a-fd69-4428-97c3-1016d97ca0e9</uuid>
Aug 27 03:58:23 user nova-compute[72990]:   <name>instance-00000020</name>
Aug 27 03:58:23 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:58:23 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:58:23 user nova-compute[72990]:   <metadata>
Aug 27 03:58:23 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:58:23 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:58:23 user nova-compute[72990]:       <nova:name>tempest-AttachVolumeTestJSON-server-1823636413</nova:name>
Aug 27 03:58:23 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:58:23</nova:creationTime>
Aug 27 03:58:23 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:58:23 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:58:23 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:58:23 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:58:23 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:58:23 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:58:23 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:58:23 user nova-compute[72990]:       <nova:owner>
Aug 27 03:58:23 user nova-compute[72990]:         <nova:user uuid="5711f5c9c8344de79b246e7eb8661ff2">tempest-AttachVolumeTestJSON-698620353-project-member</nova:user>
Aug 27 03:58:23 user nova-compute[72990]:         <nova:project uuid="e2d0a8267a0042a0ad831e7b91889dc7">tempest-AttachVolumeTestJSON-698620353</nova:project>
Aug 27 03:58:23 user nova-compute[72990]:       </nova:owner>
Aug 27 03:58:23 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:58:23 user nova-compute[72990]:       <nova:ports>
Aug 27 03:58:23 user nova-compute[72990]:         <nova:port uuid="35d5b0ac-308b-4a82-a29d-63bbe0c8ab70">
Aug 27 03:58:23 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 03:58:23 user nova-compute[72990]:         </nova:port>
Aug 27 03:58:23 user nova-compute[72990]:       </nova:ports>
Aug 27 03:58:23 user nova-compute[72990]:     </nova:instance>
Aug 27 03:58:23 user nova-compute[72990]:   </metadata>
Aug 27 03:58:23 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:58:23 user nova-compute[72990]:     <system>
Aug 27 03:58:23 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:58:23 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:58:23 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:58:23 user nova-compute[72990]:       <entry name="serial">aef3be9a-fd69-4428-97c3-1016d97ca0e9</entry>
Aug 27 03:58:23 user nova-compute[72990]:       <entry name="uuid">aef3be9a-fd69-4428-97c3-1016d97ca0e9</entry>
Aug 27 03:58:23 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:58:23 user nova-compute[72990]:     </system>
Aug 27 03:58:23 user nova-compute[72990]:   </sysinfo>
Aug 27 03:58:23 user nova-compute[72990]:   <os>
Aug 27 03:58:23 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:58:23 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:58:23 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:58:23 user nova-compute[72990]:   </os>
Aug 27 03:58:23 user nova-compute[72990]:   <features>
Aug 27 03:58:23 user nova-compute[72990]:     <acpi/>
Aug 27 03:58:23 user nova-compute[72990]:     <apic/>
Aug 27 03:58:23 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:58:23 user nova-compute[72990]:   </features>
Aug 27 03:58:23 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:58:23 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:58:23 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:58:23 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:58:23 user nova-compute[72990]:   </clock>
Aug 27 03:58:23 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:58:23 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:58:23 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:58:23 user nova-compute[72990]:   </cpu>
Aug 27 03:58:23 user nova-compute[72990]:   <devices>
Aug 27 03:58:23 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:58:23 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:58:23 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk"/>
Aug 27 03:58:23 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:58:23 user nova-compute[72990]:     </disk>
Aug 27 03:58:23 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:58:23 user nova-compute[72990]:       <mac address="fa:16:3e:dc:26:ce"/>
Aug 27 03:58:23 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:58:23 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:58:23 user nova-compute[72990]:       <target dev="tap35d5b0ac-30"/>
Aug 27 03:58:23 user nova-compute[72990]:     </interface>
Aug 27 03:58:23 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:58:23 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/console.log" append="off"/>
Aug 27 03:58:23 user nova-compute[72990]:     </serial>
Aug 27 03:58:23 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:58:23 user nova-compute[72990]:     <video>
Aug 27 03:58:23 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:58:23 user nova-compute[72990]:     </video>
Aug 27 03:58:23 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:58:23 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:58:23 user nova-compute[72990]:     </rng>
Aug 27 03:58:23 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:58:23 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:58:23 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:58:23 user nova-compute[72990]:     </memballoon>
Aug 27 03:58:23 user nova-compute[72990]:   </devices>
Aug 27 03:58:23 user nova-compute[72990]: </domain>
Aug 27 03:58:23 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1823636413',display_name='tempest-AttachVolumeTestJSON-server-1823636413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1823636413',id=32,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZNGdZSsfPtAguFJDKN3iVgvVi0aLXdyqROhiDmpQVPMLbPrj6LNqo6zh2eRkFzKq35WCkDJ3pahxf33JmxUgZuGyUraQp1NA3CDVXGmGeP0bYPK2BVWcRuq13QnqVJqg==',key_name='tempest-keypair-1602283704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d0a8267a0042a0ad831e7b91889dc7',ramdisk_id='',reservation_id='r-2qv66d4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-698620353',owner_user_name='tempest-AttachVolumeTestJSON-698620353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5711f5c9c8344de79b246e7eb8661ff2',uuid=aef3be9a-fd69-4428-97c3-1016d97ca0e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converting VIF {"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG os_vif [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35d5b0ac-30, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35d5b0ac-30, col_values=(('external_ids', {'iface-id': '35d5b0ac-308b-4a82-a29d-63bbe0c8ab70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:26:ce', 'vm-uuid': 'aef3be9a-fd69-4428-97c3-1016d97ca0e9'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:23 user nova-compute[72990]: INFO os_vif [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30')
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No VIF found with MAC fa:16:3e:dc:26:ce, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:58:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:24 user nova-compute[72990]: DEBUG nova.compute.manager [req-eca6bfce-a09a-4aa0-bd77-8a808402c080 req-42909ce2-2384-40b7-a405-1c616a09045d service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-changed-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:58:24 user nova-compute[72990]: DEBUG nova.compute.manager [req-eca6bfce-a09a-4aa0-bd77-8a808402c080 req-42909ce2-2384-40b7-a405-1c616a09045d service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Refreshing instance network info cache due to event network-changed-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:58:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-eca6bfce-a09a-4aa0-bd77-8a808402c080 req-42909ce2-2384-40b7-a405-1c616a09045d service nova] Acquiring lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:58:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-eca6bfce-a09a-4aa0-bd77-8a808402c080 req-42909ce2-2384-40b7-a405-1c616a09045d service nova] Acquired lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:58:24 user nova-compute[72990]: DEBUG nova.network.neutron [req-eca6bfce-a09a-4aa0-bd77-8a808402c080 req-42909ce2-2384-40b7-a405-1c616a09045d service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Refreshing network info cache for port 35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:58:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:25 user nova-compute[72990]: DEBUG nova.network.neutron [req-eca6bfce-a09a-4aa0-bd77-8a808402c080 req-42909ce2-2384-40b7-a405-1c616a09045d service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updated VIF entry in instance network info cache for port 35d5b0ac-308b-4a82-a29d-63bbe0c8ab70. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:58:25 user nova-compute[72990]: DEBUG nova.network.neutron [req-eca6bfce-a09a-4aa0-bd77-8a808402c080 req-42909ce2-2384-40b7-a405-1c616a09045d service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updating instance_info_cache with network_info: [{"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:58:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-eca6bfce-a09a-4aa0-bd77-8a808402c080 req-42909ce2-2384-40b7-a405-1c616a09045d service nova] Releasing lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-05242d3d-cf2c-4ecf-b7b1-7e95e5a080bd req-6720eda8-100b-4132-b54d-880c76badd53 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-05242d3d-cf2c-4ecf-b7b1-7e95e5a080bd req-6720eda8-100b-4132-b54d-880c76badd53 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-05242d3d-cf2c-4ecf-b7b1-7e95e5a080bd req-6720eda8-100b-4132-b54d-880c76badd53 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-05242d3d-cf2c-4ecf-b7b1-7e95e5a080bd req-6720eda8-100b-4132-b54d-880c76badd53 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-05242d3d-cf2c-4ecf-b7b1-7e95e5a080bd req-6720eda8-100b-4132-b54d-880c76badd53 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:58:26 user nova-compute[72990]: WARNING nova.compute.manager [req-05242d3d-cf2c-4ecf-b7b1-7e95e5a080bd req-6720eda8-100b-4132-b54d-880c76badd53 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state building and task_state spawning.
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-05242d3d-cf2c-4ecf-b7b1-7e95e5a080bd req-6720eda8-100b-4132-b54d-880c76badd53 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-05242d3d-cf2c-4ecf-b7b1-7e95e5a080bd req-6720eda8-100b-4132-b54d-880c76badd53 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-05242d3d-cf2c-4ecf-b7b1-7e95e5a080bd req-6720eda8-100b-4132-b54d-880c76badd53 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-05242d3d-cf2c-4ecf-b7b1-7e95e5a080bd req-6720eda8-100b-4132-b54d-880c76badd53 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-05242d3d-cf2c-4ecf-b7b1-7e95e5a080bd req-6720eda8-100b-4132-b54d-880c76badd53 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:58:26 user nova-compute[72990]: WARNING nova.compute.manager [req-05242d3d-cf2c-4ecf-b7b1-7e95e5a080bd req-6720eda8-100b-4132-b54d-880c76badd53 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state building and task_state spawning.
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108706.6043057, aef3be9a-fd69-4428-97c3-1016d97ca0e9 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:58:26 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] VM Resumed (Lifecycle Event)
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:58:26 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance spawned successfully.
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:58:26 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108706.6055262, aef3be9a-fd69-4428-97c3-1016d97ca0e9 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:58:26 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] VM Started (Lifecycle Event)
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:58:26 user nova-compute[72990]: INFO nova.compute.manager [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 27 03:58:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:58:26 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:58:26 user nova-compute[72990]: INFO nova.compute.manager [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Took 6.74 seconds to build instance.
Aug 27 03:58:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b6320909-1cc4-438b-9757-6681305db28a tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.833s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:32 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:58:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:58:35 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:58:36 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108701.327208, 6a44010b-9a96-4343-a35c-1f212d21e47b => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:58:36 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] VM Stopped (Lifecycle Event)
Aug 27 03:58:36 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f2d325f6-3639-4e34-b58e-1b16734d350c None None] [instance: 6a44010b-9a96-4343-a35c-1f212d21e47b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:58:36 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:58:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:36 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:58:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:36 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:58:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:58:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:39 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:58:39 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:58:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7719MB free_disk=25.09603500366211GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:58:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7114903d-465a-4ef6-b436-88af52261eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance d4f94cba-21ec-42a8-babc-859becde2c82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 0c38f974-36a1-49d3-8749-f6637ddbe6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:58:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updating instance_info_cache with network_info: [{"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-bcd09a59-c950-4143-bfc8-9a89705cca8c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:58:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:58:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 03:58:49 user nova-compute[72990]: INFO nova.compute.claims [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Claim successful on node user
Aug 27 03:58:49 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 03:58:49 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 03:58:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG nova.policy [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5cb3e0b98574319ac56c76cc1d0a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dabbdf88ca1498c95e36398ee38985a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 03:58:49 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Creating image(s)
Aug 27 03:58:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "/opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "/opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "/opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk 1073741824" returned: 0 in 0.064s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Successfully created port: fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Cannot resize image /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Ensure instance console log exists: /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Successfully updated port: fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "refresh_cache-cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquired lock "refresh_cache-cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.compute.manager [req-fbd7fd88-2285-46a5-9235-baf31106a58f req-b446e7f6-5138-4941-8ad2-d44ecbd8d73b service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Received event network-changed-fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.compute.manager [req-fbd7fd88-2285-46a5-9235-baf31106a58f req-b446e7f6-5138-4941-8ad2-d44ecbd8d73b service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Refreshing instance network info cache due to event network-changed-fe52f47f-bfc1-41bb-869b-cb4519b2a333. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fbd7fd88-2285-46a5-9235-baf31106a58f req-b446e7f6-5138-4941-8ad2-d44ecbd8d73b service nova] Acquiring lock "refresh_cache-cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.network.neutron [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Updating instance_info_cache with network_info: [{"id": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "address": "fa:16:3e:32:2f:f1", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe52f47f-bf", "ovs_interfaceid": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Releasing lock "refresh_cache-cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Instance network_info: |[{"id": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "address": "fa:16:3e:32:2f:f1", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe52f47f-bf", "ovs_interfaceid": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fbd7fd88-2285-46a5-9235-baf31106a58f req-b446e7f6-5138-4941-8ad2-d44ecbd8d73b service nova] Acquired lock "refresh_cache-cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.network.neutron [req-fbd7fd88-2285-46a5-9235-baf31106a58f req-b446e7f6-5138-4941-8ad2-d44ecbd8d73b service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Refreshing network info cache for port fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Start _get_guest_xml network_info=[{"id": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "address": "fa:16:3e:32:2f:f1", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe52f47f-bf", "ovs_interfaceid": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 03:58:51 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:58:51 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1286928730',display_name='tempest-ServersNegativeTestJSON-server-1286928730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1286928730',id=33,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dabbdf88ca1498c95e36398ee38985a',ramdisk_id='',reservation_id='r-3nbcy9i2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1760637283',owner_user_name='tempest-ServersNegativeTestJSON-1760637283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:58:50Z,user_data=None,user_id='d5cb3e0b98574319ac56c76cc1d0a796',uuid=cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "address": "fa:16:3e:32:2f:f1", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe52f47f-bf", "ovs_interfaceid": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Converting VIF {"id": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "address": "fa:16:3e:32:2f:f1", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe52f47f-bf", "ovs_interfaceid": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=fe52f47f-bfc1-41bb-869b-cb4519b2a333,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe52f47f-bf') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.objects.instance [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lazy-loading 'pci_devices' on Instance uuid cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] End _get_guest_xml xml=<domain type="kvm">
Aug 27 03:58:51 user nova-compute[72990]:   <uuid>cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3</uuid>
Aug 27 03:58:51 user nova-compute[72990]:   <name>instance-00000021</name>
Aug 27 03:58:51 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 03:58:51 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 03:58:51 user nova-compute[72990]:   <metadata>
Aug 27 03:58:51 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 03:58:51 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 03:58:51 user nova-compute[72990]:       <nova:name>tempest-ServersNegativeTestJSON-server-1286928730</nova:name>
Aug 27 03:58:51 user nova-compute[72990]:       <nova:creationTime>2023-08-27 03:58:51</nova:creationTime>
Aug 27 03:58:51 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 03:58:51 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 03:58:51 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 03:58:51 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 03:58:51 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 03:58:51 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 03:58:51 user nova-compute[72990]:       </nova:flavor>
Aug 27 03:58:51 user nova-compute[72990]:       <nova:owner>
Aug 27 03:58:51 user nova-compute[72990]:         <nova:user uuid="d5cb3e0b98574319ac56c76cc1d0a796">tempest-ServersNegativeTestJSON-1760637283-project-member</nova:user>
Aug 27 03:58:51 user nova-compute[72990]:         <nova:project uuid="9dabbdf88ca1498c95e36398ee38985a">tempest-ServersNegativeTestJSON-1760637283</nova:project>
Aug 27 03:58:51 user nova-compute[72990]:       </nova:owner>
Aug 27 03:58:51 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 03:58:51 user nova-compute[72990]:       <nova:ports>
Aug 27 03:58:51 user nova-compute[72990]:         <nova:port uuid="fe52f47f-bfc1-41bb-869b-cb4519b2a333">
Aug 27 03:58:51 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 03:58:51 user nova-compute[72990]:         </nova:port>
Aug 27 03:58:51 user nova-compute[72990]:       </nova:ports>
Aug 27 03:58:51 user nova-compute[72990]:     </nova:instance>
Aug 27 03:58:51 user nova-compute[72990]:   </metadata>
Aug 27 03:58:51 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 03:58:51 user nova-compute[72990]:     <system>
Aug 27 03:58:51 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 03:58:51 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 03:58:51 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 03:58:51 user nova-compute[72990]:       <entry name="serial">cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3</entry>
Aug 27 03:58:51 user nova-compute[72990]:       <entry name="uuid">cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3</entry>
Aug 27 03:58:51 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 03:58:51 user nova-compute[72990]:     </system>
Aug 27 03:58:51 user nova-compute[72990]:   </sysinfo>
Aug 27 03:58:51 user nova-compute[72990]:   <os>
Aug 27 03:58:51 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 03:58:51 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 03:58:51 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 03:58:51 user nova-compute[72990]:   </os>
Aug 27 03:58:51 user nova-compute[72990]:   <features>
Aug 27 03:58:51 user nova-compute[72990]:     <acpi/>
Aug 27 03:58:51 user nova-compute[72990]:     <apic/>
Aug 27 03:58:51 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 03:58:51 user nova-compute[72990]:   </features>
Aug 27 03:58:51 user nova-compute[72990]:   <clock offset="utc">
Aug 27 03:58:51 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 03:58:51 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 03:58:51 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 03:58:51 user nova-compute[72990]:   </clock>
Aug 27 03:58:51 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 03:58:51 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 03:58:51 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 03:58:51 user nova-compute[72990]:   </cpu>
Aug 27 03:58:51 user nova-compute[72990]:   <devices>
Aug 27 03:58:51 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 03:58:51 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 03:58:51 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk"/>
Aug 27 03:58:51 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 03:58:51 user nova-compute[72990]:     </disk>
Aug 27 03:58:51 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 03:58:51 user nova-compute[72990]:       <mac address="fa:16:3e:32:2f:f1"/>
Aug 27 03:58:51 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:58:51 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 03:58:51 user nova-compute[72990]:       <target dev="tapfe52f47f-bf"/>
Aug 27 03:58:51 user nova-compute[72990]:     </interface>
Aug 27 03:58:51 user nova-compute[72990]:     <serial type="pty">
Aug 27 03:58:51 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/console.log" append="off"/>
Aug 27 03:58:51 user nova-compute[72990]:     </serial>
Aug 27 03:58:51 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 03:58:51 user nova-compute[72990]:     <video>
Aug 27 03:58:51 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 03:58:51 user nova-compute[72990]:     </video>
Aug 27 03:58:51 user nova-compute[72990]:     <rng model="virtio">
Aug 27 03:58:51 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 03:58:51 user nova-compute[72990]:     </rng>
Aug 27 03:58:51 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 03:58:51 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 03:58:51 user nova-compute[72990]:       <stats period="10"/>
Aug 27 03:58:51 user nova-compute[72990]:     </memballoon>
Aug 27 03:58:51 user nova-compute[72990]:   </devices>
Aug 27 03:58:51 user nova-compute[72990]: </domain>
Aug 27 03:58:51 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1286928730',display_name='tempest-ServersNegativeTestJSON-server-1286928730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1286928730',id=33,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dabbdf88ca1498c95e36398ee38985a',ramdisk_id='',reservation_id='r-3nbcy9i2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1760637283',owner_user_name='tempest-ServersNegativeTestJSON-1760637283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T03:58:50Z,user_data=None,user_id='d5cb3e0b98574319ac56c76cc1d0a796',uuid=cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "address": "fa:16:3e:32:2f:f1", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe52f47f-bf", "ovs_interfaceid": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Converting VIF {"id": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "address": "fa:16:3e:32:2f:f1", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe52f47f-bf", "ovs_interfaceid": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=fe52f47f-bfc1-41bb-869b-cb4519b2a333,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe52f47f-bf') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG os_vif [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=fe52f47f-bfc1-41bb-869b-cb4519b2a333,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe52f47f-bf') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe52f47f-bf, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe52f47f-bf, col_values=(('external_ids', {'iface-id': 'fe52f47f-bfc1-41bb-869b-cb4519b2a333', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:2f:f1', 'vm-uuid': 'cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:51 user nova-compute[72990]: INFO os_vif [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=fe52f47f-bfc1-41bb-869b-cb4519b2a333,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe52f47f-bf')
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:58:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] No VIF found with MAC fa:16:3e:32:2f:f1, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:58:52 user nova-compute[72990]: DEBUG nova.network.neutron [req-fbd7fd88-2285-46a5-9235-baf31106a58f req-b446e7f6-5138-4941-8ad2-d44ecbd8d73b service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Updated VIF entry in instance network info cache for port fe52f47f-bfc1-41bb-869b-cb4519b2a333. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:58:52 user nova-compute[72990]: DEBUG nova.network.neutron [req-fbd7fd88-2285-46a5-9235-baf31106a58f req-b446e7f6-5138-4941-8ad2-d44ecbd8d73b service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Updating instance_info_cache with network_info: [{"id": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "address": "fa:16:3e:32:2f:f1", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe52f47f-bf", "ovs_interfaceid": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:58:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fbd7fd88-2285-46a5-9235-baf31106a58f req-b446e7f6-5138-4941-8ad2-d44ecbd8d73b service nova] Releasing lock "refresh_cache-cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:58:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1da581a-920e-4d11-99ee-30ce87ccfbc1 req-615e1509-48e5-4208-bcf3-d24c6a2a2338 service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Received event network-vif-plugged-fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:58:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1da581a-920e-4d11-99ee-30ce87ccfbc1 req-615e1509-48e5-4208-bcf3-d24c6a2a2338 service nova] Acquiring lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1da581a-920e-4d11-99ee-30ce87ccfbc1 req-615e1509-48e5-4208-bcf3-d24c6a2a2338 service nova] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f1da581a-920e-4d11-99ee-30ce87ccfbc1 req-615e1509-48e5-4208-bcf3-d24c6a2a2338 service nova] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-f1da581a-920e-4d11-99ee-30ce87ccfbc1 req-615e1509-48e5-4208-bcf3-d24c6a2a2338 service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] No waiting events found dispatching network-vif-plugged-fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:58:53 user nova-compute[72990]: WARNING nova.compute.manager [req-f1da581a-920e-4d11-99ee-30ce87ccfbc1 req-615e1509-48e5-4208-bcf3-d24c6a2a2338 service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Received unexpected event network-vif-plugged-fe52f47f-bfc1-41bb-869b-cb4519b2a333 for instance with vm_state building and task_state spawning.
Aug 27 03:58:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108735.567441, cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:58:55 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] VM Resumed (Lifecycle Event)
Aug 27 03:58:55 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Instance spawned successfully.
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 03:58:55 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108735.5682113, cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:58:55 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] VM Started (Lifecycle Event)
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 03:58:55 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 03:58:55 user nova-compute[72990]: INFO nova.compute.manager [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:58:55 user nova-compute[72990]: INFO nova.compute.manager [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Took 6.63 seconds to build instance.
Aug 27 03:58:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5efa4972-d687-46a0-902e-87377b9bce39 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.737s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a3bc9ef-c70f-4c33-8123-bb1fff63a75b req-ab9bece5-59e3-49c5-a8e6-aca2ecfe22a8 service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Received event network-vif-plugged-fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a3bc9ef-c70f-4c33-8123-bb1fff63a75b req-ab9bece5-59e3-49c5-a8e6-aca2ecfe22a8 service nova] Acquiring lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a3bc9ef-c70f-4c33-8123-bb1fff63a75b req-ab9bece5-59e3-49c5-a8e6-aca2ecfe22a8 service nova] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0a3bc9ef-c70f-4c33-8123-bb1fff63a75b req-ab9bece5-59e3-49c5-a8e6-aca2ecfe22a8 service nova] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:58:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-0a3bc9ef-c70f-4c33-8123-bb1fff63a75b req-ab9bece5-59e3-49c5-a8e6-aca2ecfe22a8 service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] No waiting events found dispatching network-vif-plugged-fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:58:55 user nova-compute[72990]: WARNING nova.compute.manager [req-0a3bc9ef-c70f-4c33-8123-bb1fff63a75b req-ab9bece5-59e3-49c5-a8e6-aca2ecfe22a8 service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Received unexpected event network-vif-plugged-fe52f47f-bfc1-41bb-869b-cb4519b2a333 for instance with vm_state active and task_state None.
Aug 27 03:58:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:58:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Acquiring lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Acquiring lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:00 user nova-compute[72990]: INFO nova.compute.manager [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Terminating instance
Aug 27 03:59:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-22cb6f98-1516-463c-a0ec-b4238b4079a4 req-29d9ec4e-f5b8-401e-9f2f-90761b687407 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Received event network-vif-unplugged-7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-22cb6f98-1516-463c-a0ec-b4238b4079a4 req-29d9ec4e-f5b8-401e-9f2f-90761b687407 service nova] Acquiring lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-22cb6f98-1516-463c-a0ec-b4238b4079a4 req-29d9ec4e-f5b8-401e-9f2f-90761b687407 service nova] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-22cb6f98-1516-463c-a0ec-b4238b4079a4 req-29d9ec4e-f5b8-401e-9f2f-90761b687407 service nova] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-22cb6f98-1516-463c-a0ec-b4238b4079a4 req-29d9ec4e-f5b8-401e-9f2f-90761b687407 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] No waiting events found dispatching network-vif-unplugged-7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-22cb6f98-1516-463c-a0ec-b4238b4079a4 req-29d9ec4e-f5b8-401e-9f2f-90761b687407 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Received event network-vif-unplugged-7a2482e8-6313-4ed3-8856-2e716e327071 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:01 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Instance destroyed successfully.
Aug 27 03:59:01 user nova-compute[72990]: DEBUG nova.objects.instance [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lazy-loading 'resources' on Instance uuid 0c38f974-36a1-49d3-8749-f6637ddbe6d8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-356533668',display_name='tempest-VolumesActionsTest-instance-356533668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-356533668',id=30,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:56:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bac6be9493d42f397f71695cfac79a0',ramdisk_id='',reservation_id='r-o2252acm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-160165565',owner_user_name='tempest-VolumesActionsTest-160165565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:56:56Z,user_data=None,user_id='897ada6905374909aa17ab70996298c0',uuid=0c38f974-36a1-49d3-8749-f6637ddbe6d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a2482e8-6313-4ed3-8856-2e716e327071", "address": "fa:16:3e:2e:1a:51", "network": {"id": "3c142189-4e25-4418-9361-4fb4564545fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1876173398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bac6be9493d42f397f71695cfac79a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2482e8-63", "ovs_interfaceid": "7a2482e8-6313-4ed3-8856-2e716e327071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Converting VIF {"id": "7a2482e8-6313-4ed3-8856-2e716e327071", "address": "fa:16:3e:2e:1a:51", "network": {"id": "3c142189-4e25-4418-9361-4fb4564545fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1876173398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bac6be9493d42f397f71695cfac79a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2482e8-63", "ovs_interfaceid": "7a2482e8-6313-4ed3-8856-2e716e327071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=7a2482e8-6313-4ed3-8856-2e716e327071,network=Network(3c142189-4e25-4418-9361-4fb4564545fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2482e8-63') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG os_vif [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=7a2482e8-6313-4ed3-8856-2e716e327071,network=Network(3c142189-4e25-4418-9361-4fb4564545fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2482e8-63') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a2482e8-63, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:59:01 user nova-compute[72990]: INFO os_vif [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=7a2482e8-6313-4ed3-8856-2e716e327071,network=Network(3c142189-4e25-4418-9361-4fb4564545fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2482e8-63')
Aug 27 03:59:01 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Deleting instance files /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8_del
Aug 27 03:59:01 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Deletion of /opt/stack/data/nova/instances/0c38f974-36a1-49d3-8749-f6637ddbe6d8_del complete
Aug 27 03:59:01 user nova-compute[72990]: INFO nova.compute.manager [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 27 03:59:01 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:59:01 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:59:02 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:59:02 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Took 0.52 seconds to deallocate network for instance.
Aug 27 03:59:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:02 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:59:02 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:59:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:02 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Deleted allocations for instance 0c38f974-36a1-49d3-8749-f6637ddbe6d8
Aug 27 03:59:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5dc5d82e-2582-4028-8640-ff7ae5f5ae0f tempest-VolumesActionsTest-160165565 tempest-VolumesActionsTest-160165565-project-member] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.953s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG nova.compute.manager [req-f81bcb65-df23-417b-a061-6de9ec9ef4b4 req-a40a50d0-ab90-4c6e-aedd-20ca26cd70a9 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Received event network-vif-plugged-7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f81bcb65-df23-417b-a061-6de9ec9ef4b4 req-a40a50d0-ab90-4c6e-aedd-20ca26cd70a9 service nova] Acquiring lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f81bcb65-df23-417b-a061-6de9ec9ef4b4 req-a40a50d0-ab90-4c6e-aedd-20ca26cd70a9 service nova] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f81bcb65-df23-417b-a061-6de9ec9ef4b4 req-a40a50d0-ab90-4c6e-aedd-20ca26cd70a9 service nova] Lock "0c38f974-36a1-49d3-8749-f6637ddbe6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG nova.compute.manager [req-f81bcb65-df23-417b-a061-6de9ec9ef4b4 req-a40a50d0-ab90-4c6e-aedd-20ca26cd70a9 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] No waiting events found dispatching network-vif-plugged-7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:59:03 user nova-compute[72990]: WARNING nova.compute.manager [req-f81bcb65-df23-417b-a061-6de9ec9ef4b4 req-a40a50d0-ab90-4c6e-aedd-20ca26cd70a9 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Received unexpected event network-vif-plugged-7a2482e8-6313-4ed3-8856-2e716e327071 for instance with vm_state deleted and task_state None.
Aug 27 03:59:03 user nova-compute[72990]: DEBUG nova.compute.manager [req-f81bcb65-df23-417b-a061-6de9ec9ef4b4 req-a40a50d0-ab90-4c6e-aedd-20ca26cd70a9 service nova] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Received event network-vif-deleted-7a2482e8-6313-4ed3-8856-2e716e327071 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "d4f94cba-21ec-42a8-babc-859becde2c82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:03 user nova-compute[72990]: INFO nova.compute.manager [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Terminating instance
Aug 27 03:59:03 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:04 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Instance destroyed successfully.
Aug 27 03:59:04 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lazy-loading 'resources' on Instance uuid d4f94cba-21ec-42a8-babc-859becde2c82 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1658965801',display_name='tempest-ServerActionsTestOtherA-server-1658965801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1658965801',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx4YMOpiFApd+UuDRSLGi+Pmb0zohcJr1O+wFKm9ZeByZUcToOSr5LVAydvhFQAlBpKXomrxo0iOLbfaHvfjryxwDtlu2Xqz9AegDptkwou3u7ClkNhexzzpMlOVgjY6Q==',key_name='tempest-keypair-749840506',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:54:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-k1hscn8l',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:56:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=d4f94cba-21ec-42a8-babc-859becde2c82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "address": "fa:16:3e:fb:cc:38", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b2e415-e4", "ovs_interfaceid": "a9b2e415-e44f-4302-9a4a-6b079b3b4c29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_vif [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9b2e415-e4, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:04 user nova-compute[72990]: INFO os_vif [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:cc:38,bridge_name='br-int',has_traffic_filtering=True,id=a9b2e415-e44f-4302-9a4a-6b079b3b4c29,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b2e415-e4')
Aug 27 03:59:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcdBbxJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:59:04 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d109758-24c4-41fc-8fec-06a91f85c32b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f412e3-be5f-4ec8-8347-203aafcb7691]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:59:04 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:59:04 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:59:04 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:59:04 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:59:04 user nova-compute[72990]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 (non-flash)
Aug 27 03:59:04 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f430b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363'): ({'sdi'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Removing single pathed devices sdi {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[41460a89-b0e2-41d1-88d2-b33c4dfabe01]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f697a9-c2be-4502-9dd7-792c26692b83]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Flushing IO for device /dev/sdi {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a92c332-41ad-4ca3-8378-b289ff317f8f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[477453a5-72f3-430d-97dd-106c89703700]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] SCSI volumes sdi have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26564613130383730', '/dev/disk/by-id/scsi-1SCST_BIOe7c7dd7f-eda10870afddb4ff', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e7c7dd7f') {{(pid=84652) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b790c9c-c776-40f7-a881-f9783c93b097]: (4, None) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.093s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[833a6ff3-d216-4eae-8207-1d341a192d15]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04c6ce6-20b3-4d95-b0e1-aef5558734ef]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260]
Aug 27 03:59:04 user nova-compute[72990]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363, portal: 172.16.0.220,3260] successful.
Aug 27 03:59:04 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e1e7bb-c0c9-4659-8796-97fded91b363 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5851fac4-d07d-4fa1-84e1-559785151e1f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] <== disconnect_volume: return (390ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:59:04 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Deleting instance files /opt/stack/data/nova/instances/d4f94cba-21ec-42a8-babc-859becde2c82_del
Aug 27 03:59:04 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Deletion of /opt/stack/data/nova/instances/d4f94cba-21ec-42a8-babc-859becde2c82_del complete
Aug 27 03:59:04 user nova-compute[72990]: INFO nova.compute.manager [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 27 03:59:04 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:59:04 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:59:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-566b2159-df29-46b9-8670-8adbaf6183ae req-b3b3cf33-2279-46be-bff0-783b4b44be90 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received event network-vif-unplugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:59:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-566b2159-df29-46b9-8670-8adbaf6183ae req-b3b3cf33-2279-46be-bff0-783b4b44be90 service nova] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-566b2159-df29-46b9-8670-8adbaf6183ae req-b3b3cf33-2279-46be-bff0-783b4b44be90 service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-566b2159-df29-46b9-8670-8adbaf6183ae req-b3b3cf33-2279-46be-bff0-783b4b44be90 service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-566b2159-df29-46b9-8670-8adbaf6183ae req-b3b3cf33-2279-46be-bff0-783b4b44be90 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] No waiting events found dispatching network-vif-unplugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:59:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-566b2159-df29-46b9-8670-8adbaf6183ae req-b3b3cf33-2279-46be-bff0-783b4b44be90 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received event network-vif-unplugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:59:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-566b2159-df29-46b9-8670-8adbaf6183ae req-b3b3cf33-2279-46be-bff0-783b4b44be90 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received event network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:59:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-566b2159-df29-46b9-8670-8adbaf6183ae req-b3b3cf33-2279-46be-bff0-783b4b44be90 service nova] Acquiring lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-566b2159-df29-46b9-8670-8adbaf6183ae req-b3b3cf33-2279-46be-bff0-783b4b44be90 service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-566b2159-df29-46b9-8670-8adbaf6183ae req-b3b3cf33-2279-46be-bff0-783b4b44be90 service nova] Lock "d4f94cba-21ec-42a8-babc-859becde2c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:05 user nova-compute[72990]: DEBUG nova.compute.manager [req-566b2159-df29-46b9-8670-8adbaf6183ae req-b3b3cf33-2279-46be-bff0-783b4b44be90 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] No waiting events found dispatching network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:59:05 user nova-compute[72990]: WARNING nova.compute.manager [req-566b2159-df29-46b9-8670-8adbaf6183ae req-b3b3cf33-2279-46be-bff0-783b4b44be90 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received unexpected event network-vif-plugged-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 for instance with vm_state active and task_state deleting.
Aug 27 03:59:06 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:59:06 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Took 1.31 seconds to deallocate network for instance.
Aug 27 03:59:06 user nova-compute[72990]: INFO nova.compute.manager [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Took 0.86 seconds to detach 1 volumes for instance.
Aug 27 03:59:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Deleting volume: a9e1e7bb-c0c9-4659-8796-97fded91b363 {{(pid=72990) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 03:59:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:07 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:59:07 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:59:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-f95e4a2b-1801-4090-8175-d7d31453d0d9 req-886d56ca-1142-4c0a-bc3d-29762b073266 service nova] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Received event network-vif-deleted-a9b2e415-e44f-4302-9a4a-6b079b3b4c29 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:59:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:07 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Deleted allocations for instance d4f94cba-21ec-42a8-babc-859becde2c82
Aug 27 03:59:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9dfce368-06e4-4715-a5cb-05a75dbb1d38 tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "d4f94cba-21ec-42a8-babc-859becde2c82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.099s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "7114903d-465a-4ef6-b436-88af52261eae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:11 user nova-compute[72990]: INFO nova.compute.manager [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Terminating instance
Aug 27 03:59:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-3d39e014-cd8c-48f7-8d08-b9d02441e302 req-8eafae05-9d4c-41bb-80ae-ec8ac439855f service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-unplugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3d39e014-cd8c-48f7-8d08-b9d02441e302 req-8eafae05-9d4c-41bb-80ae-ec8ac439855f service nova] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3d39e014-cd8c-48f7-8d08-b9d02441e302 req-8eafae05-9d4c-41bb-80ae-ec8ac439855f service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3d39e014-cd8c-48f7-8d08-b9d02441e302 req-8eafae05-9d4c-41bb-80ae-ec8ac439855f service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-3d39e014-cd8c-48f7-8d08-b9d02441e302 req-8eafae05-9d4c-41bb-80ae-ec8ac439855f service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] No waiting events found dispatching network-vif-unplugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-3d39e014-cd8c-48f7-8d08-b9d02441e302 req-8eafae05-9d4c-41bb-80ae-ec8ac439855f service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-unplugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Instance destroyed successfully.
Aug 27 03:59:12 user nova-compute[72990]: DEBUG nova.objects.instance [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'resources' on Instance uuid 7114903d-465a-4ef6-b436-88af52261eae {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334572128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-334572128',id=13,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:45:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-qru8dfhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:47:12Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=7114903d-465a-4ef6-b436-88af52261eae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "address": "fa:16:3e:75:99:66", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd721fc-eb", "ovs_interfaceid": "8bd721fc-ebab-49ab-9c7d-f900107b74b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:99:66,bridge_name='br-int',has_traffic_filtering=True,id=8bd721fc-ebab-49ab-9c7d-f900107b74b2,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd721fc-eb') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_vif [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:99:66,bridge_name='br-int',has_traffic_filtering=True,id=8bd721fc-ebab-49ab-9c7d-f900107b74b2,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd721fc-eb') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bd721fc-eb, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:12 user nova-compute[72990]: INFO os_vif [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:99:66,bridge_name='br-int',has_traffic_filtering=True,id=8bd721fc-ebab-49ab-9c7d-f900107b74b2,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd721fc-eb')
Aug 27 03:59:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxIRKtmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:59:12 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6e91b6-86b8-4990-9919-758ffdf32365]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3718f3d0-4df0-4841-80ec-391bb290aecd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:59:12 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:59:12 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 (non-flash)
Aug 27 03:59:12 user nova-compute[72990]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:59:12 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4486170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5'): ({'sdf'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Removing single pathed devices sdf {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a8ba2f-ae4c-4893-9742-cdafef249d2e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ef0677-6b53-4c28-9fc5-0b144ef5c508]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Flushing IO for device /dev/sdf {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[077dba8d-8444-478e-8a5c-0ee0558febf1]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce423126-27e0-4dbe-9b28-ec21d6522da2]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] SCSI volumes sdf have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9942630a-8804-4b7a-be8c-d3b4141d3960]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c997c07d-c00c-4e4e-83f3-799ff661d263]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5, portal: 172.16.0.220,3260]
Aug 27 03:59:12 user nova-compute[72990]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5, portal: 172.16.0.220,3260] successful.
Aug 27 03:59:12 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce017c-edc6-4e54-bed5-792dc4e365f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3350ea2b-97fe-402d-9040-130e11c0c580]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] <== disconnect_volume: return (311ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 03:59:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Deleting instance files /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae_del
Aug 27 03:59:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Deletion of /opt/stack/data/nova/instances/7114903d-465a-4ef6-b436-88af52261eae_del complete
Aug 27 03:59:12 user nova-compute[72990]: INFO nova.compute.manager [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 27 03:59:12 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 7114903d-465a-4ef6-b436-88af52261eae] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:59:12 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Took 0.46 seconds to deallocate network for instance.
Aug 27 03:59:12 user nova-compute[72990]: DEBUG nova.compute.manager [req-0e9b5206-4814-443b-839d-06fe27da3e8a req-a0ce9205-8e97-4ab7-8b51-65cb5227ca8a service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-deleted-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:59:12 user nova-compute[72990]: INFO nova.compute.manager [req-0e9b5206-4814-443b-839d-06fe27da3e8a req-a0ce9205-8e97-4ab7-8b51-65cb5227ca8a service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Neutron deleted interface 8bd721fc-ebab-49ab-9c7d-f900107b74b2; detaching it from the instance and deleting it from the info cache
Aug 27 03:59:12 user nova-compute[72990]: DEBUG nova.network.neutron [req-0e9b5206-4814-443b-839d-06fe27da3e8a req-a0ce9205-8e97-4ab7-8b51-65cb5227ca8a service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:59:12 user nova-compute[72990]: DEBUG nova.compute.manager [req-0e9b5206-4814-443b-839d-06fe27da3e8a req-a0ce9205-8e97-4ab7-8b51-65cb5227ca8a service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Detach interface failed, port_id=8bd721fc-ebab-49ab-9c7d-f900107b74b2, reason: Instance 7114903d-465a-4ef6-b436-88af52261eae could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 03:59:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-dba1bcc8-4ecb-4871-ad78-4c880210ffb8 req-6b9f3b19-2d7e-4570-b707-87aad59e7b54 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:59:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dba1bcc8-4ecb-4871-ad78-4c880210ffb8 req-6b9f3b19-2d7e-4570-b707-87aad59e7b54 service nova] Acquiring lock "7114903d-465a-4ef6-b436-88af52261eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dba1bcc8-4ecb-4871-ad78-4c880210ffb8 req-6b9f3b19-2d7e-4570-b707-87aad59e7b54 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dba1bcc8-4ecb-4871-ad78-4c880210ffb8 req-6b9f3b19-2d7e-4570-b707-87aad59e7b54 service nova] Lock "7114903d-465a-4ef6-b436-88af52261eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-dba1bcc8-4ecb-4871-ad78-4c880210ffb8 req-6b9f3b19-2d7e-4570-b707-87aad59e7b54 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] No waiting events found dispatching network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 03:59:13 user nova-compute[72990]: WARNING nova.compute.manager [req-dba1bcc8-4ecb-4871-ad78-4c880210ffb8 req-6b9f3b19-2d7e-4570-b707-87aad59e7b54 service nova] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Received unexpected event network-vif-plugged-8bd721fc-ebab-49ab-9c7d-f900107b74b2 for instance with vm_state active and task_state deleting.
Aug 27 03:59:13 user nova-compute[72990]: INFO nova.compute.manager [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Took 0.92 seconds to detach 1 volumes for instance.
Aug 27 03:59:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:14 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:59:14 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:59:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:14 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Deleted allocations for instance 7114903d-465a-4ef6-b436-88af52261eae
Aug 27 03:59:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-47f3ace4-9277-45c5-b862-5d557f47269b tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "7114903d-465a-4ef6-b436-88af52261eae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.029s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:16 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108741.716074, 0c38f974-36a1-49d3-8749-f6637ddbe6d8 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:59:16 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] VM Stopped (Lifecycle Event)
Aug 27 03:59:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3e2d80cf-4f71-4380-9d23-b08bf4736167 None None] [instance: 0c38f974-36a1-49d3-8749-f6637ddbe6d8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:59:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:19 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108744.249988, d4f94cba-21ec-42a8-babc-859becde2c82 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:59:19 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] VM Stopped (Lifecycle Event)
Aug 27 03:59:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8fc8b979-200a-4c13-bbb5-6dd327ffb058 None None] [instance: d4f94cba-21ec-42a8-babc-859becde2c82] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:59:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:27 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108752.044524, 7114903d-465a-4ef6-b436-88af52261eae => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 03:59:27 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 7114903d-465a-4ef6-b436-88af52261eae] VM Stopped (Lifecycle Event)
Aug 27 03:59:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-23f9d49f-f848-4ee5-98f8-33dc0ae91349 None None] [instance: 7114903d-465a-4ef6-b436-88af52261eae] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 03:59:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-8d63e3a3-c7d1-42ac-acdf-17767e4926f6 req-cda8cd24-ac14-4ee1-a5a4-a1bc33523595 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Received event network-changed-52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 03:59:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-8d63e3a3-c7d1-42ac-acdf-17767e4926f6 req-cda8cd24-ac14-4ee1-a5a4-a1bc33523595 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Refreshing instance network info cache due to event network-changed-52696cfb-708d-41ac-9594-1591bc9df14c. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 03:59:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8d63e3a3-c7d1-42ac-acdf-17767e4926f6 req-cda8cd24-ac14-4ee1-a5a4-a1bc33523595 service nova] Acquiring lock "refresh_cache-0ac97670-dd82-4e3f-b34c-5d9be0e36501" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 03:59:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8d63e3a3-c7d1-42ac-acdf-17767e4926f6 req-cda8cd24-ac14-4ee1-a5a4-a1bc33523595 service nova] Acquired lock "refresh_cache-0ac97670-dd82-4e3f-b34c-5d9be0e36501" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 03:59:28 user nova-compute[72990]: DEBUG nova.network.neutron [req-8d63e3a3-c7d1-42ac-acdf-17767e4926f6 req-cda8cd24-ac14-4ee1-a5a4-a1bc33523595 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Refreshing network info cache for port 52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 03:59:29 user nova-compute[72990]: DEBUG nova.network.neutron [req-8d63e3a3-c7d1-42ac-acdf-17767e4926f6 req-cda8cd24-ac14-4ee1-a5a4-a1bc33523595 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Updated VIF entry in instance network info cache for port 52696cfb-708d-41ac-9594-1591bc9df14c. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 03:59:29 user nova-compute[72990]: DEBUG nova.network.neutron [req-8d63e3a3-c7d1-42ac-acdf-17767e4926f6 req-cda8cd24-ac14-4ee1-a5a4-a1bc33523595 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Updating instance_info_cache with network_info: [{"id": "52696cfb-708d-41ac-9594-1591bc9df14c", "address": "fa:16:3e:f2:39:80", "network": {"id": "305f13a8-b1fe-4352-8ddb-457758bf97f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2115229939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d7981033f574199afbe602b19b81001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52696cfb-70", "ovs_interfaceid": "52696cfb-708d-41ac-9594-1591bc9df14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 03:59:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8d63e3a3-c7d1-42ac-acdf-17767e4926f6 req-cda8cd24-ac14-4ee1-a5a4-a1bc33523595 service nova] Releasing lock "refresh_cache-0ac97670-dd82-4e3f-b34c-5d9be0e36501" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 03:59:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:29 user nova-compute[72990]: DEBUG nova.objects.instance [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lazy-loading 'flavor' on Instance uuid 0ac97670-dd82-4e3f-b34c-5d9be0e36501 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:59:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:30 user nova-compute[72990]: INFO nova.compute.manager [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Attaching volume 20462e25-97e1-4ebd-9dd3-50ed052af584 to /dev/vdb
Aug 27 03:59:30 user nova-compute[72990]: DEBUG os_brick.utils [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd335c06-5e39-4844-a03a-1a2c55a9a67e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b512dbbe-ba2b-4276-9993-1892636c5df0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7afa6af-a88a-4bcd-9877-9de8c4530c32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cd8b15-cdbf-4dbe-97b8-345bac04e6bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:59:30 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:59:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e71ad27-18e6-436b-b38b-c1bb572e68a4]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG os_brick.utils [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:59:30 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Updating existing volume attachment record: b273dcce-289a-4abc-8998-e63f756ee6ff {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:59:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:32 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:59:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:59:35 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:59:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:37 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:59:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 03:59:37 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:59:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:37 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 03:59:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 03:59:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:40 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:59:40 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 03:59:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7910MB free_disk=25.055587768554688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 034cb1d6-25b5-499d-81b1-36adf2385242 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance bcd09a59-c950-4143-bfc8-9a89705cca8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 03:59:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLCkBMgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:59:41 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:59:41 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:59:41 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[409fb844-7c4c-425c-9666-1b70432c84a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:59:41 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff810a30-a9d0-4aa6-a56c-103d53a4d3c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584] added
Aug 27 03:59:41 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee972f37-70ba-4467-adc1-c445a6269920]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5213f1a-891a-4433-b41d-79fa51bfed45]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLCkBMgJ {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLCkBMgJ" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[607b78c8-0f07-4799-b7e8-9eae1dec8466]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uLCkBMgJ'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[34295b94-a1da-49bd-ad8d-2b475c1e13bb]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aab865-b025-423d-ad8a-b7136ce8608f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:59:41 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:59:41 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91755f5-1fd6-4727-9eca-13f58d334a97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584, portal: 172.16.0.220,3260]
Aug 27 03:59:41 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584, portal: 172.16.0.220,3260] successful.
Aug 27 03:59:41 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1d4f7e-1fd8-480c-ba9f-06040fb6e534]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4bb018-5914-45da-9fd9-2977c6ab985b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:59:41 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 03:59:41 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 03:59:41 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 03:59:41 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2b5af4-4f75-44ec-90c7-414e418fd951]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLCkBMgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:59:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Didn't find any instances for network info cache update. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23766613365316132', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766613365316132', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG nova.objects.instance [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lazy-loading 'flavor' on Instance uuid 0ac97670-dd82-4e3f-b34c-5d9be0e36501 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 03:59:42 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 03:59:42 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 03:59:42 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 03:59:42 user nova-compute[72990]:   <serial>20462e25-97e1-4ebd-9dd3-50ed052af584</serial>
Aug 27 03:59:42 user nova-compute[72990]: </disk>
Aug 27 03:59:42 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 03:59:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] No VIF found with MAC fa:16:3e:f2:39:80, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 03:59:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-079e84b6-64c8-4a98-9211-60e6543f1ffc tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.935s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG nova.objects.instance [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lazy-loading 'flavor' on Instance uuid 0ac97670-dd82-4e3f-b34c-5d9be0e36501 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 03:59:47 user nova-compute[72990]: INFO nova.compute.manager [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Attaching volume 9a7546f0-4b33-4908-a25d-9adeb3a73910 to /dev/vdc
Aug 27 03:59:47 user nova-compute[72990]: DEBUG os_brick.utils [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9fb393-ea47-43de-a7e8-522c02d8c287]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[144eac69-724d-4691-9231-36ab50a66f19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1dc232-2e06-4842-8352-f45c12fc0ad0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a352a89c-298b-404c-a490-a073bf09ce4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 03:59:47 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 03:59:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[48110ad3-d167-44ca-9c70-fddc5f2bf117]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG os_brick.utils [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Updating existing volume attachment record: 824eddc7-de55-4f22-aa33-cb934b580d23 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 03:59:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXFEyWwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 03:59:59 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:59:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:59:59 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 03:59:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 03:59:59 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8b873b-7aae-4a36-ae79-420f284982cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 03:59:59 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f2ce54-28f3-4fcc-bcef-5746b69cfd43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910] added
Aug 27 03:59:59 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9ee9f7-7cad-403a-99be-66b620fbd06b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2453b1-7a8f-46a0-94f0-0c31b5f9cc81]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 03:59:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXFEyWwf {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXFEyWwf" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[036103ea-d4bf-4bf6-8c4f-ca984ba2a64a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NXFEyWwf'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01a899c-51b2-497a-b2a5-2417d1deb3ca]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb2852c-3a4a-4d49-8395-bc40d28c9120]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:00:00 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 04:00:00 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:00:00 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 04:00:00 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f60ac6e-2ee2-489e-a87c-5b3507eec80b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910, portal: 172.16.0.220,3260]
Aug 27 04:00:00 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910, portal: 172.16.0.220,3260] successful.
Aug 27 04:00:00 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85f590e-6441-4351-9ae4-5d7db08e1d8c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7df3ca7-803c-468e-82e3-1ee028b2e0ce]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:00:00 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 04:00:00 user nova-compute[72990]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 (non-flash)
Aug 27 04:00:00 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:00:00 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 04:00:00 user nova-compute[72990]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 (non-flash)
Aug 27 04:00:00 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e8f2b9-735a-49e9-8f3d-4c8260082199]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:00 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXFEyWwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26132333436333435', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132333436333435', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG nova.objects.instance [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lazy-loading 'flavor' on Instance uuid 0ac97670-dd82-4e3f-b34c-5d9be0e36501 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:00:01 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:00:01 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 04:00:01 user nova-compute[72990]:   <target dev="vdc" bus="virtio"/>
Aug 27 04:00:01 user nova-compute[72990]:   <serial>9a7546f0-4b33-4908-a25d-9adeb3a73910</serial>
Aug 27 04:00:01 user nova-compute[72990]: </disk>
Aug 27 04:00:01 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] No VIF found with MAC fa:16:3e:f2:39:80, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "bcd09a59-c950-4143-bfc8-9a89705cca8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:01 user nova-compute[72990]: INFO nova.compute.manager [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Terminating instance
Aug 27 04:00:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1d9c829c-f959-4139-b173-12209e8b85b1 tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.149s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "034cb1d6-25b5-499d-81b1-36adf2385242" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "034cb1d6-25b5-499d-81b1-36adf2385242" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:02 user nova-compute[72990]: INFO nova.compute.manager [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Terminating instance
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-cd70041b-7ede-4b43-8050-e9199cfb7916 req-6c8a283b-fdd3-46fd-a7b5-b195c9d54ca0 service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Received event network-vif-unplugged-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cd70041b-7ede-4b43-8050-e9199cfb7916 req-6c8a283b-fdd3-46fd-a7b5-b195c9d54ca0 service nova] Acquiring lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cd70041b-7ede-4b43-8050-e9199cfb7916 req-6c8a283b-fdd3-46fd-a7b5-b195c9d54ca0 service nova] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-cd70041b-7ede-4b43-8050-e9199cfb7916 req-6c8a283b-fdd3-46fd-a7b5-b195c9d54ca0 service nova] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-cd70041b-7ede-4b43-8050-e9199cfb7916 req-6c8a283b-fdd3-46fd-a7b5-b195c9d54ca0 service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] No waiting events found dispatching network-vif-unplugged-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-cd70041b-7ede-4b43-8050-e9199cfb7916 req-6c8a283b-fdd3-46fd-a7b5-b195c9d54ca0 service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Received event network-vif-unplugged-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-917f797e-aebf-41a1-b268-9e8a07089d0a req-d7f5c6d3-5d89-45d5-bae9-f7f08b5b6c5a service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Received event network-vif-unplugged-4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-917f797e-aebf-41a1-b268-9e8a07089d0a req-d7f5c6d3-5d89-45d5-bae9-f7f08b5b6c5a service nova] Acquiring lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-917f797e-aebf-41a1-b268-9e8a07089d0a req-d7f5c6d3-5d89-45d5-bae9-f7f08b5b6c5a service nova] Lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-917f797e-aebf-41a1-b268-9e8a07089d0a req-d7f5c6d3-5d89-45d5-bae9-f7f08b5b6c5a service nova] Lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-917f797e-aebf-41a1-b268-9e8a07089d0a req-d7f5c6d3-5d89-45d5-bae9-f7f08b5b6c5a service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] No waiting events found dispatching network-vif-unplugged-4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.compute.manager [req-917f797e-aebf-41a1-b268-9e8a07089d0a req-d7f5c6d3-5d89-45d5-bae9-f7f08b5b6c5a service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Received event network-vif-unplugged-4f10397c-dcdf-4be9-8744-fe97b2046fab for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:02 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Instance destroyed successfully.
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.objects.instance [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lazy-loading 'resources' on Instance uuid bcd09a59-c950-4143-bfc8-9a89705cca8c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:00:02 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Instance destroyed successfully.
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lazy-loading 'resources' on Instance uuid 034cb1d6-25b5-499d-81b1-36adf2385242 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-310419774',display_name='tempest-ServerActionsTestOtherA-server-310419774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-310419774',id=5,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx4YMOpiFApd+UuDRSLGi+Pmb0zohcJr1O+wFKm9ZeByZUcToOSr5LVAydvhFQAlBpKXomrxo0iOLbfaHvfjryxwDtlu2Xqz9AegDptkwou3u7ClkNhexzzpMlOVgjY6Q==',key_name='tempest-keypair-749840506',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2282ed15ca724f029c368c8a5ce0f268',ramdisk_id='',reservation_id='r-u5ttx2jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-938526966',owner_user_name='tempest-ServerActionsTestOtherA-938526966-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb95e31732904174a8ebddf48c6426ed',uuid=bcd09a59-c950-4143-bfc8-9a89705cca8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converting VIF {"id": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "address": "fa:16:3e:57:8a:c0", "network": {"id": "7d6356b5-26ff-4b1b-83f9-b525f75230d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1848835739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2282ed15ca724f029c368c8a5ce0f268", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a0d97c3-c4", "ovs_interfaceid": "7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:8a:c0,bridge_name='br-int',has_traffic_filtering=True,id=7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a0d97c3-c4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG os_vif [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:8a:c0,bridge_name='br-int',has_traffic_filtering=True,id=7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a0d97c3-c4') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-470204338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-470204338',id=2,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:40:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='183297ba5b6549fdb39f2135d92b3794',ramdisk_id='',reservation_id='r-c6b5r5n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:42:21Z,user_data=None,user_id='858a63e8d5964f38ad776985cfbe9121',uuid=034cb1d6-25b5-499d-81b1-36adf2385242,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converting VIF {"id": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "address": "fa:16:3e:ea:bf:f0", "network": {"id": "bf5f82cd-49dc-4fdb-b28e-18bd15a23c07", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-71550283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183297ba5b6549fdb39f2135d92b3794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f10397c-dc", "ovs_interfaceid": "4f10397c-dcdf-4be9-8744-fe97b2046fab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:bf:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f10397c-dcdf-4be9-8744-fe97b2046fab,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f10397c-dc') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG os_vif [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:bf:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f10397c-dcdf-4be9-8744-fe97b2046fab,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f10397c-dc') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a0d97c3-c4, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f10397c-dc, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:00:02 user nova-compute[72990]: INFO os_vif [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:8a:c0,bridge_name='br-int',has_traffic_filtering=True,id=7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813,network=Network(7d6356b5-26ff-4b1b-83f9-b525f75230d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a0d97c3-c4')
Aug 27 04:00:02 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Deleting instance files /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c_del
Aug 27 04:00:02 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Deletion of /opt/stack/data/nova/instances/bcd09a59-c950-4143-bfc8-9a89705cca8c_del complete
Aug 27 04:00:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:00:02 user nova-compute[72990]: INFO os_vif [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:bf:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f10397c-dcdf-4be9-8744-fe97b2046fab,network=Network(bf5f82cd-49dc-4fdb-b28e-18bd15a23c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f10397c-dc')
Aug 27 04:00:02 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Deleting instance files /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242_del
Aug 27 04:00:02 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Deletion of /opt/stack/data/nova/instances/034cb1d6-25b5-499d-81b1-36adf2385242_del complete
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:03 user nova-compute[72990]: INFO nova.compute.manager [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:00:03 user nova-compute[72990]: INFO nova.compute.manager [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:00:03 user nova-compute[72990]: INFO nova.compute.manager [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Detaching volume 9a7546f0-4b33-4908-a25d-9adeb3a73910
Aug 27 04:00:03 user nova-compute[72990]: INFO nova.virt.block_device [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Attempting to driver detach volume 9a7546f0-4b33-4908-a25d-9adeb3a73910 from mountpoint /dev/vdc
Aug 27 04:00:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Attempting to detach device vdc from instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:00:03 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:00:03 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 04:00:03 user nova-compute[72990]:   <target dev="vdc" bus="virtio"/>
Aug 27 04:00:03 user nova-compute[72990]:   <serial>9a7546f0-4b33-4908-a25d-9adeb3a73910</serial>
Aug 27 04:00:03 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 04:00:03 user nova-compute[72990]: </disk>
Aug 27 04:00:03 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:00:03 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Successfully detached device vdc from instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 from the persistent domain config.
Aug 27 04:00:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:00:03 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:00:03 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 04:00:03 user nova-compute[72990]:   <target dev="vdc" bus="virtio"/>
Aug 27 04:00:03 user nova-compute[72990]:   <serial>9a7546f0-4b33-4908-a25d-9adeb3a73910</serial>
Aug 27 04:00:03 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 04:00:03 user nova-compute[72990]: </disk>
Aug 27 04:00:03 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693108803.6233332, 0ac97670-dd82-4e3f-b34c-5d9be0e36501 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:00:03 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Successfully detached device vdc from instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 from the live domain config.
Aug 27 04:00:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXFEyWwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:00:03 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8dcceb-6960-49f5-ab59-1d96982cd4db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f5bf82-9e42-4e74-87c8-e088605155f9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:00:03 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 04:00:03 user nova-compute[72990]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 (non-flash)
Aug 27 04:00:03 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:00:03 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 04:00:03 user nova-compute[72990]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 (non-flash)
Aug 27 04:00:03 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72370f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9eae5f-2563-4a9d-b9bf-188213481f2c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aa81f7-e0ea-4959-977c-7b445287b1ac]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[579375b0-2bbe-4c3b-ad7c-af43b31225fc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da3fa1d-6f41-42e1-9ab0-c2d94912f21f]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f334a857-2318-482e-aa22-5cad8b2f2aea]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8546a463-56e3-4fc8-80f0-3eeb6d859218]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910, portal: 172.16.0.220,3260]
Aug 27 04:00:03 user nova-compute[72990]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910, portal: 172.16.0.220,3260] successful.
Aug 27 04:00:03 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7546f0-4b33-4908-a25d-9adeb3a73910 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c63dd64-f31c-451c-841d-f61f4c0d20db]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] <== disconnect_volume: return (311ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:00:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-3718e5de-fe86-47f8-be55-4098c2c2dc13 req-33ef9c38-1114-4a9d-9613-0098a1f568c2 service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Received event network-vif-plugged-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3718e5de-fe86-47f8-be55-4098c2c2dc13 req-33ef9c38-1114-4a9d-9613-0098a1f568c2 service nova] Acquiring lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3718e5de-fe86-47f8-be55-4098c2c2dc13 req-33ef9c38-1114-4a9d-9613-0098a1f568c2 service nova] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3718e5de-fe86-47f8-be55-4098c2c2dc13 req-33ef9c38-1114-4a9d-9613-0098a1f568c2 service nova] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-3718e5de-fe86-47f8-be55-4098c2c2dc13 req-33ef9c38-1114-4a9d-9613-0098a1f568c2 service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] No waiting events found dispatching network-vif-plugged-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:00:04 user nova-compute[72990]: WARNING nova.compute.manager [req-3718e5de-fe86-47f8-be55-4098c2c2dc13 req-33ef9c38-1114-4a9d-9613-0098a1f568c2 service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Received unexpected event network-vif-plugged-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 for instance with vm_state active and task_state deleting.
Aug 27 04:00:04 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:00:04 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Took 1.12 seconds to deallocate network for instance.
Aug 27 04:00:04 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Took 1.14 seconds to deallocate network for instance.
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-9692f711-7106-4c0d-8c23-5d4c22ed5441 req-9e0977d7-e641-4c10-a1d6-5e61688f8be5 service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Received event network-vif-plugged-4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9692f711-7106-4c0d-8c23-5d4c22ed5441 req-9e0977d7-e641-4c10-a1d6-5e61688f8be5 service nova] Acquiring lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9692f711-7106-4c0d-8c23-5d4c22ed5441 req-9e0977d7-e641-4c10-a1d6-5e61688f8be5 service nova] Lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9692f711-7106-4c0d-8c23-5d4c22ed5441 req-9e0977d7-e641-4c10-a1d6-5e61688f8be5 service nova] Lock "034cb1d6-25b5-499d-81b1-36adf2385242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG nova.compute.manager [req-9692f711-7106-4c0d-8c23-5d4c22ed5441 req-9e0977d7-e641-4c10-a1d6-5e61688f8be5 service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] No waiting events found dispatching network-vif-plugged-4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:00:04 user nova-compute[72990]: WARNING nova.compute.manager [req-9692f711-7106-4c0d-8c23-5d4c22ed5441 req-9e0977d7-e641-4c10-a1d6-5e61688f8be5 service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Received unexpected event network-vif-plugged-4f10397c-dcdf-4be9-8744-fe97b2046fab for instance with vm_state deleted and task_state None.
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.236s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:04 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Deleted allocations for instance 034cb1d6-25b5-499d-81b1-36adf2385242
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2e4f2757-c014-466e-816c-3d0a03b946af tempest-ServerBootFromVolumeStableRescueTest-1839224225 tempest-ServerBootFromVolumeStableRescueTest-1839224225-project-member] Lock "034cb1d6-25b5-499d-81b1-36adf2385242" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.548s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG nova.objects.instance [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lazy-loading 'flavor' on Instance uuid 0ac97670-dd82-4e3f-b34c-5d9be0e36501 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:00:04 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Deleted allocations for instance bcd09a59-c950-4143-bfc8-9a89705cca8c
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-099ef1a8-62c2-4a73-815c-77f7e566b6ce tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.750s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cdb61c8f-23ce-45e6-b6b7-568bbe53f85a tempest-ServerActionsTestOtherA-938526966 tempest-ServerActionsTestOtherA-938526966-project-member] Lock "bcd09a59-c950-4143-bfc8-9a89705cca8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.149s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:06 user nova-compute[72990]: DEBUG nova.compute.manager [req-628a6e0c-dcfc-4b9b-b5b8-77897243c639 req-c6295896-0585-4999-94f1-a206e8a8e4d9 service nova] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Received event network-vif-deleted-4f10397c-dcdf-4be9-8744-fe97b2046fab {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:00:06 user nova-compute[72990]: DEBUG nova.compute.manager [req-628a6e0c-dcfc-4b9b-b5b8-77897243c639 req-c6295896-0585-4999-94f1-a206e8a8e4d9 service nova] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Received event network-vif-deleted-7a0d97c3-c4b0-4b99-9bfa-e1ea5d5d7813 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:00:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-158df49a-49d2-4b69-ae15-8869db7b2ad8 req-587b8491-d1e3-4d83-b957-6778c3d399e6 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-changed-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:00:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-158df49a-49d2-4b69-ae15-8869db7b2ad8 req-587b8491-d1e3-4d83-b957-6778c3d399e6 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Refreshing instance network info cache due to event network-changed-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:00:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-158df49a-49d2-4b69-ae15-8869db7b2ad8 req-587b8491-d1e3-4d83-b957-6778c3d399e6 service nova] Acquiring lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:00:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-158df49a-49d2-4b69-ae15-8869db7b2ad8 req-587b8491-d1e3-4d83-b957-6778c3d399e6 service nova] Acquired lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:00:11 user nova-compute[72990]: DEBUG nova.network.neutron [req-158df49a-49d2-4b69-ae15-8869db7b2ad8 req-587b8491-d1e3-4d83-b957-6778c3d399e6 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Refreshing network info cache for port 35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:00:11 user nova-compute[72990]: DEBUG nova.network.neutron [req-158df49a-49d2-4b69-ae15-8869db7b2ad8 req-587b8491-d1e3-4d83-b957-6778c3d399e6 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updated VIF entry in instance network info cache for port 35d5b0ac-308b-4a82-a29d-63bbe0c8ab70. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:00:11 user nova-compute[72990]: DEBUG nova.network.neutron [req-158df49a-49d2-4b69-ae15-8869db7b2ad8 req-587b8491-d1e3-4d83-b957-6778c3d399e6 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updating instance_info_cache with network_info: [{"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:00:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-158df49a-49d2-4b69-ae15-8869db7b2ad8 req-587b8491-d1e3-4d83-b957-6778c3d399e6 service nova] Releasing lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:00:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG nova.objects.instance [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:16 user nova-compute[72990]: INFO nova.compute.manager [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Attaching volume 2dc92d69-6572-4583-94d4-fb25f5eb3714 to /dev/vdb
Aug 27 04:00:16 user nova-compute[72990]: DEBUG os_brick.utils [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e819ee3a-0722-4862-a1df-41ccbfd37671]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b93036c-0a6f-4866-aa05-8c4dbc7527cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ee48bb-a3c8-4558-bec9-ccc5c7f57264]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f059f98-8942-4299-b70f-c56f30eb92a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:00:16 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:00:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b07894-fde6-45f1-be12-fb864ede0462]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG os_brick.utils [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:00:16 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updating existing volume attachment record: 4bcb21d0-b60c-4ee0-8189-3f05f0d5cc14 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:00:17 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108802.9094439, bcd09a59-c950-4143-bfc8-9a89705cca8c => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:00:17 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] VM Stopped (Lifecycle Event)
Aug 27 04:00:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:17 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108802.9211192, 034cb1d6-25b5-499d-81b1-36adf2385242 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:00:17 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] VM Stopped (Lifecycle Event)
Aug 27 04:00:17 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cebb7cc2-d708-4b12-b7a0-8d74850f06ea None None] [instance: 034cb1d6-25b5-499d-81b1-36adf2385242] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:00:17 user nova-compute[72990]: DEBUG nova.compute.manager [None req-005e3dfc-669b-4cd9-bef7-f55d1148c709 None None] [instance: bcd09a59-c950-4143-bfc8-9a89705cca8c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:00:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:00:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:00:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:00:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:00:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAMHsEcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:00:28 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:00:28 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:00:28 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0941fdbf-2c06-4298-bf6b-13037e32df39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:00:28 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[344a3ee4-0614-496c-999b-6923fc021d3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714] added
Aug 27 04:00:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fb76fb-abdc-4117-a14e-c5b91392043c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cbc745-d356-4970-8f68-22bce07606ab]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CAMHsEcm {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CAMHsEcm" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ea57eb-5f56-4b95-bf61-9901783ddef7]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CAMHsEcm'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[11406252-8beb-40b5-a3b5-49d806859324]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaaca15-22b9-410b-9955-807993f2439c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:00:28 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 04:00:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:00:28 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 04:00:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[116706b6-714a-4c1e-93fa-0641ed5958fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260]
Aug 27 04:00:28 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260] successful.
Aug 27 04:00:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff222ab3-982e-4983-b290-32bf15093a4a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3810b17-5495-4c61-93e7-87648a20c467]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:00:28 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 04:00:28 user nova-compute[72990]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:00:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:00:28 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 04:00:28 user nova-compute[72990]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:00:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[df083f1d-6ca1-46c3-8a37-7edd73d7a5c5]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:00:29 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:00:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAMHsEcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:00:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:00:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23435353435383932', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:00:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435353435383932', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:00:29 user nova-compute[72990]: DEBUG nova.objects.instance [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:00:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:00:29 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:00:29 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 04:00:29 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:00:29 user nova-compute[72990]:   <serial>2dc92d69-6572-4583-94d4-fb25f5eb3714</serial>
Aug 27 04:00:29 user nova-compute[72990]: </disk>
Aug 27 04:00:29 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:00:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:00:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:00:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No VIF found with MAC fa:16:3e:dc:26:ce, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:00:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ffde7c42-0662-483a-ad31-2e2550885fa7 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.113s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a42b1f0d-0b2f-4f9c-9a9f-09ace7829356 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a42b1f0d-0b2f-4f9c-9a9f-09ace7829356 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a42b1f0d-0b2f-4f9c-9a9f-09ace7829356 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a42b1f0d-0b2f-4f9c-9a9f-09ace7829356 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72990) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG nova.objects.instance [None req-a42b1f0d-0b2f-4f9c-9a9f-09ace7829356 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-23daaa2c-9458-4eb3-8368-8c25b103c9fd req-5e949962-8a29-4387-8f7e-c9bd7655217a service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-unplugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-23daaa2c-9458-4eb3-8368-8c25b103c9fd req-5e949962-8a29-4387-8f7e-c9bd7655217a service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-23daaa2c-9458-4eb3-8368-8c25b103c9fd req-5e949962-8a29-4387-8f7e-c9bd7655217a service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-23daaa2c-9458-4eb3-8368-8c25b103c9fd req-5e949962-8a29-4387-8f7e-c9bd7655217a service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-23daaa2c-9458-4eb3-8368-8c25b103c9fd req-5e949962-8a29-4387-8f7e-c9bd7655217a service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-unplugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:00:31 user nova-compute[72990]: WARNING nova.compute.manager [req-23daaa2c-9458-4eb3-8368-8c25b103c9fd req-5e949962-8a29-4387-8f7e-c9bd7655217a service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-unplugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state active and task_state powering-off.
Aug 27 04:00:32 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance destroyed successfully.
Aug 27 04:00:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a42b1f0d-0b2f-4f9c-9a9f-09ace7829356 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:00:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a42b1f0d-0b2f-4f9c-9a9f-09ace7829356 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.917s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:33 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:00:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-0726fb7a-56d7-4681-8ce5-27b2c6fa4a01 req-282f5e88-b1a2-4b66-a588-ac8fba6c2ae1 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:00:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0726fb7a-56d7-4681-8ce5-27b2c6fa4a01 req-282f5e88-b1a2-4b66-a588-ac8fba6c2ae1 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0726fb7a-56d7-4681-8ce5-27b2c6fa4a01 req-282f5e88-b1a2-4b66-a588-ac8fba6c2ae1 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0726fb7a-56d7-4681-8ce5-27b2c6fa4a01 req-282f5e88-b1a2-4b66-a588-ac8fba6c2ae1 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-0726fb7a-56d7-4681-8ce5-27b2c6fa4a01 req-282f5e88-b1a2-4b66-a588-ac8fba6c2ae1 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:00:33 user nova-compute[72990]: WARNING nova.compute.manager [req-0726fb7a-56d7-4681-8ce5-27b2c6fa4a01 req-282f5e88-b1a2-4b66-a588-ac8fba6c2ae1 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state stopped and task_state None.
Aug 27 04:00:36 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:00:37 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:00:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:00:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:00:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:00:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:00:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:00:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:38 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:00:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:38 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:00:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:00:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:00:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:00:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:40 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:00:40 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:00:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8278MB free_disk=25.181228637695312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:00:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.264s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:00:41 user nova-compute[72990]: INFO nova.compute.claims [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Claim successful on node user
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:00:41 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:00:41 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Creating image(s)
Aug 27 04:00:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "/opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "/opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:41 user nova-compute[72990]: DEBUG nova.policy [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5cb3e0b98574319ac56c76cc1d0a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dabbdf88ca1498c95e36398ee38985a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk 1073741824" returned: 0 in 0.055s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Skipping network cache update for instance because it is Building. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Cannot resize image /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Ensure instance console log exists: /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:00:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:43 user nova-compute[72990]: DEBUG nova.network.neutron [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Successfully created port: 869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:00:43 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [{"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:00:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-7835f781-b543-4370-922b-3d2a76f9821b" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:00:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.network.neutron [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Successfully updated port: 869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "refresh_cache-5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquired lock "refresh_cache-5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.network.neutron [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-ae87679f-ed70-481a-9f9b-84318f394ef4 req-fbd1d712-2b83-4b78-b857-723f4959baec service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Received event network-changed-869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-ae87679f-ed70-481a-9f9b-84318f394ef4 req-fbd1d712-2b83-4b78-b857-723f4959baec service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Refreshing instance network info cache due to event network-changed-869f225f-e1cf-4188-af5e-0889efd60c23. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ae87679f-ed70-481a-9f9b-84318f394ef4 req-fbd1d712-2b83-4b78-b857-723f4959baec service nova] Acquiring lock "refresh_cache-5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.network.neutron [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.network.neutron [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Updating instance_info_cache with network_info: [{"id": "869f225f-e1cf-4188-af5e-0889efd60c23", "address": "fa:16:3e:5a:ab:c9", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869f225f-e1", "ovs_interfaceid": "869f225f-e1cf-4188-af5e-0889efd60c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Releasing lock "refresh_cache-5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Instance network_info: |[{"id": "869f225f-e1cf-4188-af5e-0889efd60c23", "address": "fa:16:3e:5a:ab:c9", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869f225f-e1", "ovs_interfaceid": "869f225f-e1cf-4188-af5e-0889efd60c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ae87679f-ed70-481a-9f9b-84318f394ef4 req-fbd1d712-2b83-4b78-b857-723f4959baec service nova] Acquired lock "refresh_cache-5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.network.neutron [req-ae87679f-ed70-481a-9f9b-84318f394ef4 req-fbd1d712-2b83-4b78-b857-723f4959baec service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Refreshing network info cache for port 869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Start _get_guest_xml network_info=[{"id": "869f225f-e1cf-4188-af5e-0889efd60c23", "address": "fa:16:3e:5a:ab:c9", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869f225f-e1", "ovs_interfaceid": "869f225f-e1cf-4188-af5e-0889efd60c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:00:44 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:00:44 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:00:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1405406236',display_name='tempest-ServersNegativeTestJSON-server-1405406236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1405406236',id=34,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dabbdf88ca1498c95e36398ee38985a',ramdisk_id='',reservation_id='r-t2t0c0o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1760637283',owner_user_name='tempest-ServersNegativeTestJSON-1760637283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:00:42Z,user_data=None,user_id='d5cb3e0b98574319ac56c76cc1d0a796',uuid=5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "869f225f-e1cf-4188-af5e-0889efd60c23", "address": "fa:16:3e:5a:ab:c9", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869f225f-e1", "ovs_interfaceid": "869f225f-e1cf-4188-af5e-0889efd60c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Converting VIF {"id": "869f225f-e1cf-4188-af5e-0889efd60c23", "address": "fa:16:3e:5a:ab:c9", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869f225f-e1", "ovs_interfaceid": "869f225f-e1cf-4188-af5e-0889efd60c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ab:c9,bridge_name='br-int',has_traffic_filtering=True,id=869f225f-e1cf-4188-af5e-0889efd60c23,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869f225f-e1') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.objects.instance [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:00:44 user nova-compute[72990]:   <uuid>5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8</uuid>
Aug 27 04:00:44 user nova-compute[72990]:   <name>instance-00000022</name>
Aug 27 04:00:44 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:00:44 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:00:44 user nova-compute[72990]:   <metadata>
Aug 27 04:00:44 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:00:44 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:00:44 user nova-compute[72990]:       <nova:name>tempest-ServersNegativeTestJSON-server-1405406236</nova:name>
Aug 27 04:00:44 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:00:44</nova:creationTime>
Aug 27 04:00:44 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:00:44 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:00:44 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:00:44 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:00:44 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:00:44 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:00:44 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:00:44 user nova-compute[72990]:       <nova:owner>
Aug 27 04:00:44 user nova-compute[72990]:         <nova:user uuid="d5cb3e0b98574319ac56c76cc1d0a796">tempest-ServersNegativeTestJSON-1760637283-project-member</nova:user>
Aug 27 04:00:44 user nova-compute[72990]:         <nova:project uuid="9dabbdf88ca1498c95e36398ee38985a">tempest-ServersNegativeTestJSON-1760637283</nova:project>
Aug 27 04:00:44 user nova-compute[72990]:       </nova:owner>
Aug 27 04:00:44 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 04:00:44 user nova-compute[72990]:       <nova:ports>
Aug 27 04:00:44 user nova-compute[72990]:         <nova:port uuid="869f225f-e1cf-4188-af5e-0889efd60c23">
Aug 27 04:00:44 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 04:00:44 user nova-compute[72990]:         </nova:port>
Aug 27 04:00:44 user nova-compute[72990]:       </nova:ports>
Aug 27 04:00:44 user nova-compute[72990]:     </nova:instance>
Aug 27 04:00:44 user nova-compute[72990]:   </metadata>
Aug 27 04:00:44 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:00:44 user nova-compute[72990]:     <system>
Aug 27 04:00:44 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:00:44 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:00:44 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:00:44 user nova-compute[72990]:       <entry name="serial">5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8</entry>
Aug 27 04:00:44 user nova-compute[72990]:       <entry name="uuid">5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8</entry>
Aug 27 04:00:44 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:00:44 user nova-compute[72990]:     </system>
Aug 27 04:00:44 user nova-compute[72990]:   </sysinfo>
Aug 27 04:00:44 user nova-compute[72990]:   <os>
Aug 27 04:00:44 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:00:44 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:00:44 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:00:44 user nova-compute[72990]:   </os>
Aug 27 04:00:44 user nova-compute[72990]:   <features>
Aug 27 04:00:44 user nova-compute[72990]:     <acpi/>
Aug 27 04:00:44 user nova-compute[72990]:     <apic/>
Aug 27 04:00:44 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:00:44 user nova-compute[72990]:   </features>
Aug 27 04:00:44 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:00:44 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:00:44 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:00:44 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:00:44 user nova-compute[72990]:   </clock>
Aug 27 04:00:44 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:00:44 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:00:44 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:00:44 user nova-compute[72990]:   </cpu>
Aug 27 04:00:44 user nova-compute[72990]:   <devices>
Aug 27 04:00:44 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:00:44 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:00:44 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk"/>
Aug 27 04:00:44 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:00:44 user nova-compute[72990]:     </disk>
Aug 27 04:00:44 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:00:44 user nova-compute[72990]:       <mac address="fa:16:3e:5a:ab:c9"/>
Aug 27 04:00:44 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:00:44 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:00:44 user nova-compute[72990]:       <target dev="tap869f225f-e1"/>
Aug 27 04:00:44 user nova-compute[72990]:     </interface>
Aug 27 04:00:44 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:00:44 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/console.log" append="off"/>
Aug 27 04:00:44 user nova-compute[72990]:     </serial>
Aug 27 04:00:44 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:00:44 user nova-compute[72990]:     <video>
Aug 27 04:00:44 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:00:44 user nova-compute[72990]:     </video>
Aug 27 04:00:44 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:00:44 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:00:44 user nova-compute[72990]:     </rng>
Aug 27 04:00:44 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:00:44 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:00:44 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:00:44 user nova-compute[72990]:     </memballoon>
Aug 27 04:00:44 user nova-compute[72990]:   </devices>
Aug 27 04:00:44 user nova-compute[72990]: </domain>
Aug 27 04:00:44 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:00:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1405406236',display_name='tempest-ServersNegativeTestJSON-server-1405406236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1405406236',id=34,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dabbdf88ca1498c95e36398ee38985a',ramdisk_id='',reservation_id='r-t2t0c0o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1760637283',owner_user_name='tempest-ServersNegativeTestJSON-1760637283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:00:42Z,user_data=None,user_id='d5cb3e0b98574319ac56c76cc1d0a796',uuid=5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "869f225f-e1cf-4188-af5e-0889efd60c23", "address": "fa:16:3e:5a:ab:c9", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869f225f-e1", "ovs_interfaceid": "869f225f-e1cf-4188-af5e-0889efd60c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Converting VIF {"id": "869f225f-e1cf-4188-af5e-0889efd60c23", "address": "fa:16:3e:5a:ab:c9", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869f225f-e1", "ovs_interfaceid": "869f225f-e1cf-4188-af5e-0889efd60c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ab:c9,bridge_name='br-int',has_traffic_filtering=True,id=869f225f-e1cf-4188-af5e-0889efd60c23,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869f225f-e1') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG os_vif [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ab:c9,bridge_name='br-int',has_traffic_filtering=True,id=869f225f-e1cf-4188-af5e-0889efd60c23,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869f225f-e1') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap869f225f-e1, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap869f225f-e1, col_values=(('external_ids', {'iface-id': '869f225f-e1cf-4188-af5e-0889efd60c23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:ab:c9', 'vm-uuid': '5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:44 user nova-compute[72990]: INFO os_vif [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ab:c9,bridge_name='br-int',has_traffic_filtering=True,id=869f225f-e1cf-4188-af5e-0889efd60c23,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869f225f-e1')
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:00:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] No VIF found with MAC fa:16:3e:5a:ab:c9, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:00:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-ae87679f-ed70-481a-9f9b-84318f394ef4 req-fbd1d712-2b83-4b78-b857-723f4959baec service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Updated VIF entry in instance network info cache for port 869f225f-e1cf-4188-af5e-0889efd60c23. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:00:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-ae87679f-ed70-481a-9f9b-84318f394ef4 req-fbd1d712-2b83-4b78-b857-723f4959baec service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Updating instance_info_cache with network_info: [{"id": "869f225f-e1cf-4188-af5e-0889efd60c23", "address": "fa:16:3e:5a:ab:c9", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869f225f-e1", "ovs_interfaceid": "869f225f-e1cf-4188-af5e-0889efd60c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:00:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ae87679f-ed70-481a-9f9b-84318f394ef4 req-fbd1d712-2b83-4b78-b857-723f4959baec service nova] Releasing lock "refresh_cache-5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:00:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-5fa35944-cbf0-4dba-a79f-ea9aaa95b35b req-4afbc57b-4626-439a-8259-d196e454d198 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Received event network-vif-plugged-869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:00:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5fa35944-cbf0-4dba-a79f-ea9aaa95b35b req-4afbc57b-4626-439a-8259-d196e454d198 service nova] Acquiring lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5fa35944-cbf0-4dba-a79f-ea9aaa95b35b req-4afbc57b-4626-439a-8259-d196e454d198 service nova] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5fa35944-cbf0-4dba-a79f-ea9aaa95b35b req-4afbc57b-4626-439a-8259-d196e454d198 service nova] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-5fa35944-cbf0-4dba-a79f-ea9aaa95b35b req-4afbc57b-4626-439a-8259-d196e454d198 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] No waiting events found dispatching network-vif-plugged-869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:00:46 user nova-compute[72990]: WARNING nova.compute.manager [req-5fa35944-cbf0-4dba-a79f-ea9aaa95b35b req-4afbc57b-4626-439a-8259-d196e454d198 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Received unexpected event network-vif-plugged-869f225f-e1cf-4188-af5e-0889efd60c23 for instance with vm_state building and task_state spawning.
Aug 27 04:00:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:47 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108832.3818498, aef3be9a-fd69-4428-97c3-1016d97ca0e9 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:00:47 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] VM Stopped (Lifecycle Event)
Aug 27 04:00:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b5bf400b-8b0d-4e1f-a3d5-e218478c8043 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:00:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b5bf400b-8b0d-4e1f-a3d5-e218478c8043 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:00:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108848.2974975, 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:00:48 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] VM Resumed (Lifecycle Event)
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:00:48 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Instance spawned successfully.
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:00:48 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108848.29902, 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:00:48 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] VM Started (Lifecycle Event)
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:00:48 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:00:48 user nova-compute[72990]: INFO nova.compute.manager [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Took 6.57 seconds to spawn the instance on the hypervisor.
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-7f4a2645-b924-4c00-a629-a21b6ca1f661 req-8d3d7b73-c063-4eed-b982-eda3a561a7a7 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Received event network-vif-plugged-869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7f4a2645-b924-4c00-a629-a21b6ca1f661 req-8d3d7b73-c063-4eed-b982-eda3a561a7a7 service nova] Acquiring lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7f4a2645-b924-4c00-a629-a21b6ca1f661 req-8d3d7b73-c063-4eed-b982-eda3a561a7a7 service nova] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7f4a2645-b924-4c00-a629-a21b6ca1f661 req-8d3d7b73-c063-4eed-b982-eda3a561a7a7 service nova] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-7f4a2645-b924-4c00-a629-a21b6ca1f661 req-8d3d7b73-c063-4eed-b982-eda3a561a7a7 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] No waiting events found dispatching network-vif-plugged-869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:00:48 user nova-compute[72990]: WARNING nova.compute.manager [req-7f4a2645-b924-4c00-a629-a21b6ca1f661 req-8d3d7b73-c063-4eed-b982-eda3a561a7a7 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Received unexpected event network-vif-plugged-869f225f-e1cf-4188-af5e-0889efd60c23 for instance with vm_state active and task_state None.
Aug 27 04:00:48 user nova-compute[72990]: INFO nova.compute.manager [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Took 7.54 seconds to build instance.
Aug 27 04:00:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-618b7426-6aed-483b-be1e-9f7584b3d5b0 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.671s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:00:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:00:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:00:53 user nova-compute[72990]: INFO nova.compute.manager [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Detaching volume 20462e25-97e1-4ebd-9dd3-50ed052af584
Aug 27 04:00:53 user nova-compute[72990]: INFO nova.virt.block_device [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Attempting to driver detach volume 20462e25-97e1-4ebd-9dd3-50ed052af584 from mountpoint /dev/vdb
Aug 27 04:00:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Attempting to detach device vdb from instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:00:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:00:53 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:00:53 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:00:53 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:00:53 user nova-compute[72990]:   <serial>20462e25-97e1-4ebd-9dd3-50ed052af584</serial>
Aug 27 04:00:53 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:00:53 user nova-compute[72990]: </disk>
Aug 27 04:00:53 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:00:53 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Successfully detached device vdb from instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 from the persistent domain config.
Aug 27 04:00:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:00:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:00:53 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:00:53 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:00:53 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:00:53 user nova-compute[72990]:   <serial>20462e25-97e1-4ebd-9dd3-50ed052af584</serial>
Aug 27 04:00:53 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:00:53 user nova-compute[72990]: </disk>
Aug 27 04:00:53 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693108854.340919, 0ac97670-dd82-4e3f-b34c-5d9be0e36501 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:00:54 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Successfully detached device vdb from instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 from the live domain config.
Aug 27 04:00:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLCkBMgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:00:54 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e0b479-8e67-4dbf-98ed-8a0661f369c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2182f52-58e3-43b9-af55-a295290b86f1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:00:54 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 04:00:54 user nova-compute[72990]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:00:54 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:00:54 user nova-compute[72990]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 (non-flash)
Aug 27 04:00:54 user nova-compute[72990]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:00:54 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7237e2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d9e9dd-54bc-4bb7-b018-ba0d9f94f709]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10165f9-c87e-44ad-b798-66fc6aaa9c2d]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2c86da-2981-4a88-9077-e723439aeb1d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1ef15f-68a7-4d2b-8fc5-3ee2ce391370]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1484783-376d-4f4e-9226-d4613e7a39e3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0c2b51-c325-4b89-a97a-de39c7856226]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584, portal: 172.16.0.220,3260]
Aug 27 04:00:54 user nova-compute[72990]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584, portal: 172.16.0.220,3260] successful.
Aug 27 04:00:54 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20462e25-97e1-4ebd-9dd3-50ed052af584 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0740f13a-4e19-45c8-b54a-35dfaaac73be]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] <== disconnect_volume: return (337ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:00:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:00:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:01 user nova-compute[72990]: DEBUG nova.objects.instance [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lazy-loading 'flavor' on Instance uuid 0ac97670-dd82-4e3f-b34c-5d9be0e36501 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:01:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b09a875e-5c4a-4b38-8e6b-e6985eb48b0f tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.590s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Acquiring lock "fa2cafdb-77ef-4d45-8523-c29c2a258475" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:01:15 user nova-compute[72990]: INFO nova.compute.claims [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Claim successful on node user
Aug 27 04:01:15 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG nova.compute.manager [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG nova.compute.manager [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG nova.network.neutron [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:01:15 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:01:15 user nova-compute[72990]: DEBUG nova.compute.manager [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG nova.compute.manager [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:01:15 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Creating image(s)
Aug 27 04:01:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "/opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "/opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG nova.policy [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eaef551320464a43a6c372b055b8b32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d930e204d44f738a0817dd476900dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.206s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk 1073741824" returned: 0 in 0.050s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG nova.network.neutron [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Successfully created port: a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Cannot resize image /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Ensure instance console log exists: /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:17 user nova-compute[72990]: DEBUG nova.network.neutron [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Successfully updated port: a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:01:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Acquiring lock "refresh_cache-fa2cafdb-77ef-4d45-8523-c29c2a258475" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:01:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Acquired lock "refresh_cache-fa2cafdb-77ef-4d45-8523-c29c2a258475" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:01:17 user nova-compute[72990]: DEBUG nova.network.neutron [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:01:17 user nova-compute[72990]: DEBUG nova.network.neutron [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:01:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-efbad7ff-91e8-4f59-adfd-1a3158e830d5 req-db00550a-2dca-4a69-a6ef-4737050a4fbc service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Received event network-changed-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:01:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-efbad7ff-91e8-4f59-adfd-1a3158e830d5 req-db00550a-2dca-4a69-a6ef-4737050a4fbc service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Refreshing instance network info cache due to event network-changed-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:01:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-efbad7ff-91e8-4f59-adfd-1a3158e830d5 req-db00550a-2dca-4a69-a6ef-4737050a4fbc service nova] Acquiring lock "refresh_cache-fa2cafdb-77ef-4d45-8523-c29c2a258475" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:01:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.network.neutron [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Updating instance_info_cache with network_info: [{"id": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "address": "fa:16:3e:3c:d6:a7", "network": {"id": "858361c3-ce2f-4005-80e2-73c398e1d484", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1261fcea31c84dcc85c1c48bca6d4fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b8f19-8a", "ovs_interfaceid": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Releasing lock "refresh_cache-fa2cafdb-77ef-4d45-8523-c29c2a258475" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.compute.manager [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Instance network_info: |[{"id": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "address": "fa:16:3e:3c:d6:a7", "network": {"id": "858361c3-ce2f-4005-80e2-73c398e1d484", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1261fcea31c84dcc85c1c48bca6d4fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b8f19-8a", "ovs_interfaceid": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-efbad7ff-91e8-4f59-adfd-1a3158e830d5 req-db00550a-2dca-4a69-a6ef-4737050a4fbc service nova] Acquired lock "refresh_cache-fa2cafdb-77ef-4d45-8523-c29c2a258475" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.network.neutron [req-efbad7ff-91e8-4f59-adfd-1a3158e830d5 req-db00550a-2dca-4a69-a6ef-4737050a4fbc service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Refreshing network info cache for port a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Start _get_guest_xml network_info=[{"id": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "address": "fa:16:3e:3c:d6:a7", "network": {"id": "858361c3-ce2f-4005-80e2-73c398e1d484", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1261fcea31c84dcc85c1c48bca6d4fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b8f19-8a", "ovs_interfaceid": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:01:18 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:01:18 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-217934922',display_name='tempest-VolumesNegativeTest-instance-217934922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-217934922',id=35,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d930e204d44f738a0817dd476900dc',ramdisk_id='',reservation_id='r-ezw085ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1975228831',owner_user_name='tempest-VolumesNegativeTest-1975228831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:01:16Z,user_data=None,user_id='eaef551320464a43a6c372b055b8b32b',uuid=fa2cafdb-77ef-4d45-8523-c29c2a258475,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "address": "fa:16:3e:3c:d6:a7", "network": {"id": "858361c3-ce2f-4005-80e2-73c398e1d484", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1261fcea31c84dcc85c1c48bca6d4fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b8f19-8a", "ovs_interfaceid": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Converting VIF {"id": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "address": "fa:16:3e:3c:d6:a7", "network": {"id": "858361c3-ce2f-4005-80e2-73c398e1d484", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1261fcea31c84dcc85c1c48bca6d4fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b8f19-8a", "ovs_interfaceid": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d6:a7,bridge_name='br-int',has_traffic_filtering=True,id=a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498,network=Network(858361c3-ce2f-4005-80e2-73c398e1d484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b8f19-8a') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lazy-loading 'pci_devices' on Instance uuid fa2cafdb-77ef-4d45-8523-c29c2a258475 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:01:18 user nova-compute[72990]:   <uuid>fa2cafdb-77ef-4d45-8523-c29c2a258475</uuid>
Aug 27 04:01:18 user nova-compute[72990]:   <name>instance-00000023</name>
Aug 27 04:01:18 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:01:18 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:01:18 user nova-compute[72990]:   <metadata>
Aug 27 04:01:18 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:01:18 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:01:18 user nova-compute[72990]:       <nova:name>tempest-VolumesNegativeTest-instance-217934922</nova:name>
Aug 27 04:01:18 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:01:18</nova:creationTime>
Aug 27 04:01:18 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:01:18 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:01:18 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:01:18 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:01:18 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:01:18 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:01:18 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:01:18 user nova-compute[72990]:       <nova:owner>
Aug 27 04:01:18 user nova-compute[72990]:         <nova:user uuid="eaef551320464a43a6c372b055b8b32b">tempest-VolumesNegativeTest-1975228831-project-member</nova:user>
Aug 27 04:01:18 user nova-compute[72990]:         <nova:project uuid="b3d930e204d44f738a0817dd476900dc">tempest-VolumesNegativeTest-1975228831</nova:project>
Aug 27 04:01:18 user nova-compute[72990]:       </nova:owner>
Aug 27 04:01:18 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 04:01:18 user nova-compute[72990]:       <nova:ports>
Aug 27 04:01:18 user nova-compute[72990]:         <nova:port uuid="a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498">
Aug 27 04:01:18 user nova-compute[72990]:           <nova:ip type="fixed" address="192.168.233.4" ipVersion="4"/>
Aug 27 04:01:18 user nova-compute[72990]:         </nova:port>
Aug 27 04:01:18 user nova-compute[72990]:       </nova:ports>
Aug 27 04:01:18 user nova-compute[72990]:     </nova:instance>
Aug 27 04:01:18 user nova-compute[72990]:   </metadata>
Aug 27 04:01:18 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:01:18 user nova-compute[72990]:     <system>
Aug 27 04:01:18 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:01:18 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:01:18 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:01:18 user nova-compute[72990]:       <entry name="serial">fa2cafdb-77ef-4d45-8523-c29c2a258475</entry>
Aug 27 04:01:18 user nova-compute[72990]:       <entry name="uuid">fa2cafdb-77ef-4d45-8523-c29c2a258475</entry>
Aug 27 04:01:18 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:01:18 user nova-compute[72990]:     </system>
Aug 27 04:01:18 user nova-compute[72990]:   </sysinfo>
Aug 27 04:01:18 user nova-compute[72990]:   <os>
Aug 27 04:01:18 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:01:18 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:01:18 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:01:18 user nova-compute[72990]:   </os>
Aug 27 04:01:18 user nova-compute[72990]:   <features>
Aug 27 04:01:18 user nova-compute[72990]:     <acpi/>
Aug 27 04:01:18 user nova-compute[72990]:     <apic/>
Aug 27 04:01:18 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:01:18 user nova-compute[72990]:   </features>
Aug 27 04:01:18 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:01:18 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:01:18 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:01:18 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:01:18 user nova-compute[72990]:   </clock>
Aug 27 04:01:18 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:01:18 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:01:18 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:01:18 user nova-compute[72990]:   </cpu>
Aug 27 04:01:18 user nova-compute[72990]:   <devices>
Aug 27 04:01:18 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:01:18 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:01:18 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk"/>
Aug 27 04:01:18 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:01:18 user nova-compute[72990]:     </disk>
Aug 27 04:01:18 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:01:18 user nova-compute[72990]:       <mac address="fa:16:3e:3c:d6:a7"/>
Aug 27 04:01:18 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:01:18 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:01:18 user nova-compute[72990]:       <target dev="tapa44b8f19-8a"/>
Aug 27 04:01:18 user nova-compute[72990]:     </interface>
Aug 27 04:01:18 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:01:18 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/console.log" append="off"/>
Aug 27 04:01:18 user nova-compute[72990]:     </serial>
Aug 27 04:01:18 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:01:18 user nova-compute[72990]:     <video>
Aug 27 04:01:18 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:01:18 user nova-compute[72990]:     </video>
Aug 27 04:01:18 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:01:18 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:01:18 user nova-compute[72990]:     </rng>
Aug 27 04:01:18 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:01:18 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:01:18 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:01:18 user nova-compute[72990]:     </memballoon>
Aug 27 04:01:18 user nova-compute[72990]:   </devices>
Aug 27 04:01:18 user nova-compute[72990]: </domain>
Aug 27 04:01:18 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-217934922',display_name='tempest-VolumesNegativeTest-instance-217934922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-217934922',id=35,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d930e204d44f738a0817dd476900dc',ramdisk_id='',reservation_id='r-ezw085ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1975228831',owner_user_name='tempest-VolumesNegativeTest-1975228831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:01:16Z,user_data=None,user_id='eaef551320464a43a6c372b055b8b32b',uuid=fa2cafdb-77ef-4d45-8523-c29c2a258475,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "address": "fa:16:3e:3c:d6:a7", "network": {"id": "858361c3-ce2f-4005-80e2-73c398e1d484", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1261fcea31c84dcc85c1c48bca6d4fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b8f19-8a", "ovs_interfaceid": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Converting VIF {"id": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "address": "fa:16:3e:3c:d6:a7", "network": {"id": "858361c3-ce2f-4005-80e2-73c398e1d484", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1261fcea31c84dcc85c1c48bca6d4fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b8f19-8a", "ovs_interfaceid": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d6:a7,bridge_name='br-int',has_traffic_filtering=True,id=a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498,network=Network(858361c3-ce2f-4005-80e2-73c398e1d484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b8f19-8a') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG os_vif [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d6:a7,bridge_name='br-int',has_traffic_filtering=True,id=a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498,network=Network(858361c3-ce2f-4005-80e2-73c398e1d484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b8f19-8a') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa44b8f19-8a, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa44b8f19-8a, col_values=(('external_ids', {'iface-id': 'a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:d6:a7', 'vm-uuid': 'fa2cafdb-77ef-4d45-8523-c29c2a258475'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:18 user nova-compute[72990]: INFO os_vif [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d6:a7,bridge_name='br-int',has_traffic_filtering=True,id=a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498,network=Network(858361c3-ce2f-4005-80e2-73c398e1d484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b8f19-8a')
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] No VIF found with MAC fa:16:3e:3c:d6:a7, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.network.neutron [req-efbad7ff-91e8-4f59-adfd-1a3158e830d5 req-db00550a-2dca-4a69-a6ef-4737050a4fbc service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Updated VIF entry in instance network info cache for port a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG nova.network.neutron [req-efbad7ff-91e8-4f59-adfd-1a3158e830d5 req-db00550a-2dca-4a69-a6ef-4737050a4fbc service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Updating instance_info_cache with network_info: [{"id": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "address": "fa:16:3e:3c:d6:a7", "network": {"id": "858361c3-ce2f-4005-80e2-73c398e1d484", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1261fcea31c84dcc85c1c48bca6d4fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b8f19-8a", "ovs_interfaceid": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:01:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-efbad7ff-91e8-4f59-adfd-1a3158e830d5 req-db00550a-2dca-4a69-a6ef-4737050a4fbc service nova] Releasing lock "refresh_cache-fa2cafdb-77ef-4d45-8523-c29c2a258475" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:01:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108882.1215084, fa2cafdb-77ef-4d45-8523-c29c2a258475 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:01:22 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] VM Resumed (Lifecycle Event)
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:01:22 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Instance spawned successfully.
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:01:22 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108882.1225355, fa2cafdb-77ef-4d45-8523-c29c2a258475 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:01:22 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] VM Started (Lifecycle Event)
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:01:22 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:01:22 user nova-compute[72990]: INFO nova.compute.manager [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Took 6.70 seconds to spawn the instance on the hypervisor.
Aug 27 04:01:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:01:22 user nova-compute[72990]: INFO nova.compute.manager [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Took 7.43 seconds to build instance.
Aug 27 04:01:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88d611cc-d34f-49a3-9fa5-044b370b4cb0 tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.537s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-5a89b502-a735-4c5d-b761-a362ef860d2e req-e0068dd0-eaa6-4965-bebb-b9501c0446a2 service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Received event network-vif-plugged-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:01:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5a89b502-a735-4c5d-b761-a362ef860d2e req-e0068dd0-eaa6-4965-bebb-b9501c0446a2 service nova] Acquiring lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5a89b502-a735-4c5d-b761-a362ef860d2e req-e0068dd0-eaa6-4965-bebb-b9501c0446a2 service nova] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5a89b502-a735-4c5d-b761-a362ef860d2e req-e0068dd0-eaa6-4965-bebb-b9501c0446a2 service nova] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-5a89b502-a735-4c5d-b761-a362ef860d2e req-e0068dd0-eaa6-4965-bebb-b9501c0446a2 service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] No waiting events found dispatching network-vif-plugged-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:01:26 user nova-compute[72990]: WARNING nova.compute.manager [req-5a89b502-a735-4c5d-b761-a362ef860d2e req-e0068dd0-eaa6-4965-bebb-b9501c0446a2 service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Received unexpected event network-vif-plugged-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 for instance with vm_state active and task_state None.
Aug 27 04:01:26 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:01:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 04:01:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] There are 0 instances to clean {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 04:01:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-fdbab965-0787-43e5-881a-57f4a485bdbc req-98aee58d-d394-49bb-8a42-d8958a648966 service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Received event network-vif-plugged-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:01:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fdbab965-0787-43e5-881a-57f4a485bdbc req-98aee58d-d394-49bb-8a42-d8958a648966 service nova] Acquiring lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fdbab965-0787-43e5-881a-57f4a485bdbc req-98aee58d-d394-49bb-8a42-d8958a648966 service nova] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fdbab965-0787-43e5-881a-57f4a485bdbc req-98aee58d-d394-49bb-8a42-d8958a648966 service nova] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-fdbab965-0787-43e5-881a-57f4a485bdbc req-98aee58d-d394-49bb-8a42-d8958a648966 service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] No waiting events found dispatching network-vif-plugged-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:01:28 user nova-compute[72990]: WARNING nova.compute.manager [req-fdbab965-0787-43e5-881a-57f4a485bdbc req-98aee58d-d394-49bb-8a42-d8958a648966 service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Received unexpected event network-vif-plugged-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 for instance with vm_state active and task_state None.
Aug 27 04:01:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:01:32 user nova-compute[72990]: INFO nova.compute.claims [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Claim successful on node user
Aug 27 04:01:32 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:01:32 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:01:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:32 user nova-compute[72990]: DEBUG nova.policy [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49273c77b235424a8dc317decffa357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591e030390fe4f76803a298194788068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG nova.compute.manager [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:01:33 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Creating image(s)
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "/opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "/opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "/opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.195s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk 1073741824" returned: 0 in 0.064s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.208s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG nova.network.neutron [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Successfully created port: 9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Cannot resize image /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Ensure instance console log exists: /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:34 user nova-compute[72990]: DEBUG nova.network.neutron [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Successfully updated port: 9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:01:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "refresh_cache-eeaea5e8-16c9-4a0d-b296-e883311331ac" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:01:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquired lock "refresh_cache-eeaea5e8-16c9-4a0d-b296-e883311331ac" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:01:34 user nova-compute[72990]: DEBUG nova.network.neutron [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:01:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-9540c27c-ba73-45b7-aa03-937e16b2dab8 req-06f68795-aaca-454b-aa3a-9a5a8b80f06e service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Received event network-changed-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:01:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-9540c27c-ba73-45b7-aa03-937e16b2dab8 req-06f68795-aaca-454b-aa3a-9a5a8b80f06e service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Refreshing instance network info cache due to event network-changed-9198f9ec-e89a-4cde-81fe-e8156d77c6b8. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:01:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9540c27c-ba73-45b7-aa03-937e16b2dab8 req-06f68795-aaca-454b-aa3a-9a5a8b80f06e service nova] Acquiring lock "refresh_cache-eeaea5e8-16c9-4a0d-b296-e883311331ac" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:01:34 user nova-compute[72990]: DEBUG nova.network.neutron [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.network.neutron [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Updating instance_info_cache with network_info: [{"id": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "address": "fa:16:3e:07:44:36", "network": {"id": "f6683e38-2ada-42b7-bf0b-5437286bb052", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1399247984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "591e030390fe4f76803a298194788068", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9198f9ec-e8", "ovs_interfaceid": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Releasing lock "refresh_cache-eeaea5e8-16c9-4a0d-b296-e883311331ac" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.compute.manager [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Instance network_info: |[{"id": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "address": "fa:16:3e:07:44:36", "network": {"id": "f6683e38-2ada-42b7-bf0b-5437286bb052", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1399247984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "591e030390fe4f76803a298194788068", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9198f9ec-e8", "ovs_interfaceid": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9540c27c-ba73-45b7-aa03-937e16b2dab8 req-06f68795-aaca-454b-aa3a-9a5a8b80f06e service nova] Acquired lock "refresh_cache-eeaea5e8-16c9-4a0d-b296-e883311331ac" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.network.neutron [req-9540c27c-ba73-45b7-aa03-937e16b2dab8 req-06f68795-aaca-454b-aa3a-9a5a8b80f06e service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Refreshing network info cache for port 9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Start _get_guest_xml network_info=[{"id": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "address": "fa:16:3e:07:44:36", "network": {"id": "f6683e38-2ada-42b7-bf0b-5437286bb052", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1399247984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "591e030390fe4f76803a298194788068", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9198f9ec-e8", "ovs_interfaceid": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:01:35 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:01:35 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-531191223',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-531191223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5311912',id=36,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7yQo13t5Mf+W4votkNtmuBMOlO1zK08P8/Ymaw++SIpC6Uv7rmjWMYs3qJ4aoWW26ieuNmyXGHegJ0Jq4IlERg1DAwO331OSKTn3DxfrJMRm5huopyn2nVE9bdZqWgBA==',key_name='tempest-keypair-1583905272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='591e030390fe4f76803a298194788068',ramdisk_id='',reservation_id='r-v1308e90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1531810617',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:01:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49273c77b235424a8dc317decffa357d',uuid=eeaea5e8-16c9-4a0d-b296-e883311331ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "address": "fa:16:3e:07:44:36", "network": {"id": "f6683e38-2ada-42b7-bf0b-5437286bb052", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1399247984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "591e030390fe4f76803a298194788068", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9198f9ec-e8", "ovs_interfaceid": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Converting VIF {"id": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "address": "fa:16:3e:07:44:36", "network": {"id": "f6683e38-2ada-42b7-bf0b-5437286bb052", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1399247984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "591e030390fe4f76803a298194788068", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9198f9ec-e8", "ovs_interfaceid": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:44:36,bridge_name='br-int',has_traffic_filtering=True,id=9198f9ec-e89a-4cde-81fe-e8156d77c6b8,network=Network(f6683e38-2ada-42b7-bf0b-5437286bb052),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9198f9ec-e8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.objects.instance [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lazy-loading 'pci_devices' on Instance uuid eeaea5e8-16c9-4a0d-b296-e883311331ac {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:01:35 user nova-compute[72990]:   <uuid>eeaea5e8-16c9-4a0d-b296-e883311331ac</uuid>
Aug 27 04:01:35 user nova-compute[72990]:   <name>instance-00000024</name>
Aug 27 04:01:35 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:01:35 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:01:35 user nova-compute[72990]:   <metadata>
Aug 27 04:01:35 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:01:35 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:01:35 user nova-compute[72990]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-531191223</nova:name>
Aug 27 04:01:35 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:01:35</nova:creationTime>
Aug 27 04:01:35 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:01:35 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:01:35 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:01:35 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:01:35 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:01:35 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:01:35 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:01:35 user nova-compute[72990]:       <nova:owner>
Aug 27 04:01:35 user nova-compute[72990]:         <nova:user uuid="49273c77b235424a8dc317decffa357d">tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member</nova:user>
Aug 27 04:01:35 user nova-compute[72990]:         <nova:project uuid="591e030390fe4f76803a298194788068">tempest-TestServerVolumeAttachScenarioOldVersion-1531810617</nova:project>
Aug 27 04:01:35 user nova-compute[72990]:       </nova:owner>
Aug 27 04:01:35 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 04:01:35 user nova-compute[72990]:       <nova:ports>
Aug 27 04:01:35 user nova-compute[72990]:         <nova:port uuid="9198f9ec-e89a-4cde-81fe-e8156d77c6b8">
Aug 27 04:01:35 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 04:01:35 user nova-compute[72990]:         </nova:port>
Aug 27 04:01:35 user nova-compute[72990]:       </nova:ports>
Aug 27 04:01:35 user nova-compute[72990]:     </nova:instance>
Aug 27 04:01:35 user nova-compute[72990]:   </metadata>
Aug 27 04:01:35 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:01:35 user nova-compute[72990]:     <system>
Aug 27 04:01:35 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:01:35 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:01:35 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:01:35 user nova-compute[72990]:       <entry name="serial">eeaea5e8-16c9-4a0d-b296-e883311331ac</entry>
Aug 27 04:01:35 user nova-compute[72990]:       <entry name="uuid">eeaea5e8-16c9-4a0d-b296-e883311331ac</entry>
Aug 27 04:01:35 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:01:35 user nova-compute[72990]:     </system>
Aug 27 04:01:35 user nova-compute[72990]:   </sysinfo>
Aug 27 04:01:35 user nova-compute[72990]:   <os>
Aug 27 04:01:35 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:01:35 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:01:35 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:01:35 user nova-compute[72990]:   </os>
Aug 27 04:01:35 user nova-compute[72990]:   <features>
Aug 27 04:01:35 user nova-compute[72990]:     <acpi/>
Aug 27 04:01:35 user nova-compute[72990]:     <apic/>
Aug 27 04:01:35 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:01:35 user nova-compute[72990]:   </features>
Aug 27 04:01:35 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:01:35 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:01:35 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:01:35 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:01:35 user nova-compute[72990]:   </clock>
Aug 27 04:01:35 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:01:35 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:01:35 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:01:35 user nova-compute[72990]:   </cpu>
Aug 27 04:01:35 user nova-compute[72990]:   <devices>
Aug 27 04:01:35 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:01:35 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:01:35 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk"/>
Aug 27 04:01:35 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:01:35 user nova-compute[72990]:     </disk>
Aug 27 04:01:35 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:01:35 user nova-compute[72990]:       <mac address="fa:16:3e:07:44:36"/>
Aug 27 04:01:35 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:01:35 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:01:35 user nova-compute[72990]:       <target dev="tap9198f9ec-e8"/>
Aug 27 04:01:35 user nova-compute[72990]:     </interface>
Aug 27 04:01:35 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:01:35 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/console.log" append="off"/>
Aug 27 04:01:35 user nova-compute[72990]:     </serial>
Aug 27 04:01:35 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:01:35 user nova-compute[72990]:     <video>
Aug 27 04:01:35 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:01:35 user nova-compute[72990]:     </video>
Aug 27 04:01:35 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:01:35 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:01:35 user nova-compute[72990]:     </rng>
Aug 27 04:01:35 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:01:35 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:01:35 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:01:35 user nova-compute[72990]:     </memballoon>
Aug 27 04:01:35 user nova-compute[72990]:   </devices>
Aug 27 04:01:35 user nova-compute[72990]: </domain>
Aug 27 04:01:35 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-531191223',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-531191223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5311912',id=36,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7yQo13t5Mf+W4votkNtmuBMOlO1zK08P8/Ymaw++SIpC6Uv7rmjWMYs3qJ4aoWW26ieuNmyXGHegJ0Jq4IlERg1DAwO331OSKTn3DxfrJMRm5huopyn2nVE9bdZqWgBA==',key_name='tempest-keypair-1583905272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='591e030390fe4f76803a298194788068',ramdisk_id='',reservation_id='r-v1308e90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1531810617',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:01:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49273c77b235424a8dc317decffa357d',uuid=eeaea5e8-16c9-4a0d-b296-e883311331ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "address": "fa:16:3e:07:44:36", "network": {"id": "f6683e38-2ada-42b7-bf0b-5437286bb052", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1399247984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "591e030390fe4f76803a298194788068", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9198f9ec-e8", "ovs_interfaceid": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Converting VIF {"id": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "address": "fa:16:3e:07:44:36", "network": {"id": "f6683e38-2ada-42b7-bf0b-5437286bb052", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1399247984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "591e030390fe4f76803a298194788068", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9198f9ec-e8", "ovs_interfaceid": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:44:36,bridge_name='br-int',has_traffic_filtering=True,id=9198f9ec-e89a-4cde-81fe-e8156d77c6b8,network=Network(f6683e38-2ada-42b7-bf0b-5437286bb052),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9198f9ec-e8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG os_vif [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:44:36,bridge_name='br-int',has_traffic_filtering=True,id=9198f9ec-e89a-4cde-81fe-e8156d77c6b8,network=Network(f6683e38-2ada-42b7-bf0b-5437286bb052),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9198f9ec-e8') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9198f9ec-e8, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9198f9ec-e8, col_values=(('external_ids', {'iface-id': '9198f9ec-e89a-4cde-81fe-e8156d77c6b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:44:36', 'vm-uuid': 'eeaea5e8-16c9-4a0d-b296-e883311331ac'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:35 user nova-compute[72990]: INFO os_vif [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:44:36,bridge_name='br-int',has_traffic_filtering=True,id=9198f9ec-e89a-4cde-81fe-e8156d77c6b8,network=Network(f6683e38-2ada-42b7-bf0b-5437286bb052),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9198f9ec-e8')
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] No VIF found with MAC fa:16:3e:07:44:36, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.network.neutron [req-9540c27c-ba73-45b7-aa03-937e16b2dab8 req-06f68795-aaca-454b-aa3a-9a5a8b80f06e service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Updated VIF entry in instance network info cache for port 9198f9ec-e89a-4cde-81fe-e8156d77c6b8. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG nova.network.neutron [req-9540c27c-ba73-45b7-aa03-937e16b2dab8 req-06f68795-aaca-454b-aa3a-9a5a8b80f06e service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Updating instance_info_cache with network_info: [{"id": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "address": "fa:16:3e:07:44:36", "network": {"id": "f6683e38-2ada-42b7-bf0b-5437286bb052", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1399247984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "591e030390fe4f76803a298194788068", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9198f9ec-e8", "ovs_interfaceid": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:01:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9540c27c-ba73-45b7-aa03-937e16b2dab8 req-06f68795-aaca-454b-aa3a-9a5a8b80f06e service nova] Releasing lock "refresh_cache-eeaea5e8-16c9-4a0d-b296-e883311331ac" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:01:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-bd8a2d7e-d3d8-44c7-bc49-26ece2d8276e req-9e664f17-ec56-438a-a59c-7c6663525fda service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Received event network-vif-plugged-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:01:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bd8a2d7e-d3d8-44c7-bc49-26ece2d8276e req-9e664f17-ec56-438a-a59c-7c6663525fda service nova] Acquiring lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bd8a2d7e-d3d8-44c7-bc49-26ece2d8276e req-9e664f17-ec56-438a-a59c-7c6663525fda service nova] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bd8a2d7e-d3d8-44c7-bc49-26ece2d8276e req-9e664f17-ec56-438a-a59c-7c6663525fda service nova] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-bd8a2d7e-d3d8-44c7-bc49-26ece2d8276e req-9e664f17-ec56-438a-a59c-7c6663525fda service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] No waiting events found dispatching network-vif-plugged-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:01:37 user nova-compute[72990]: WARNING nova.compute.manager [req-bd8a2d7e-d3d8-44c7-bc49-26ece2d8276e req-9e664f17-ec56-438a-a59c-7c6663525fda service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Received unexpected event network-vif-plugged-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 for instance with vm_state building and task_state spawning.
Aug 27 04:01:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:38 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108898.9209733, eeaea5e8-16c9-4a0d-b296-e883311331ac => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:01:38 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] VM Resumed (Lifecycle Event)
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:01:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Instance spawned successfully.
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:01:38 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:01:38 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108898.9229805, eeaea5e8-16c9-4a0d-b296-e883311331ac => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:01:38 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] VM Started (Lifecycle Event)
Aug 27 04:01:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:01:39 user nova-compute[72990]: INFO nova.compute.manager [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 27 04:01:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:01:39 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:01:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-5cc1772a-c91c-411f-9a63-89cbf2c1f901 req-75911b2f-a98c-4c2e-a593-27f03338af24 service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Received event network-vif-plugged-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5cc1772a-c91c-411f-9a63-89cbf2c1f901 req-75911b2f-a98c-4c2e-a593-27f03338af24 service nova] Acquiring lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5cc1772a-c91c-411f-9a63-89cbf2c1f901 req-75911b2f-a98c-4c2e-a593-27f03338af24 service nova] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5cc1772a-c91c-411f-9a63-89cbf2c1f901 req-75911b2f-a98c-4c2e-a593-27f03338af24 service nova] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-5cc1772a-c91c-411f-9a63-89cbf2c1f901 req-75911b2f-a98c-4c2e-a593-27f03338af24 service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] No waiting events found dispatching network-vif-plugged-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:01:39 user nova-compute[72990]: WARNING nova.compute.manager [req-5cc1772a-c91c-411f-9a63-89cbf2c1f901 req-75911b2f-a98c-4c2e-a593-27f03338af24 service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Received unexpected event network-vif-plugged-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 for instance with vm_state building and task_state spawning.
Aug 27 04:01:39 user nova-compute[72990]: INFO nova.compute.manager [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Took 6.83 seconds to build instance.
Aug 27 04:01:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-6c8d1cb5-d8c2-4f89-ac87-4c1ffb9a3ab0 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.948s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:01:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:01:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:01:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:01:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:01:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7892MB free_disk=25.11003875732422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance fa2cafdb-77ef-4d45-8523-c29c2a258475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance eeaea5e8-16c9-4a0d-b296-e883311331ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing inventories for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating ProviderTree inventory for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating inventory in ProviderTree for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing aggregate associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, aggregates: None {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 04:01:43 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing trait associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:44 user nova-compute[72990]: INFO nova.compute.manager [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Terminating instance
Aug 27 04:01:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.908s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7c7e5f5-ff58-4ac4-a615-51ca5a66e393 req-51c61626-e81e-42ec-9085-afa915de9c6a service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Received event network-vif-unplugged-52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7c7e5f5-ff58-4ac4-a615-51ca5a66e393 req-51c61626-e81e-42ec-9085-afa915de9c6a service nova] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7c7e5f5-ff58-4ac4-a615-51ca5a66e393 req-51c61626-e81e-42ec-9085-afa915de9c6a service nova] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b7c7e5f5-ff58-4ac4-a615-51ca5a66e393 req-51c61626-e81e-42ec-9085-afa915de9c6a service nova] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7c7e5f5-ff58-4ac4-a615-51ca5a66e393 req-51c61626-e81e-42ec-9085-afa915de9c6a service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] No waiting events found dispatching network-vif-unplugged-52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-b7c7e5f5-ff58-4ac4-a615-51ca5a66e393 req-51c61626-e81e-42ec-9085-afa915de9c6a service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Received event network-vif-unplugged-52696cfb-708d-41ac-9594-1591bc9df14c for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:44 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Instance destroyed successfully.
Aug 27 04:01:44 user nova-compute[72990]: DEBUG nova.objects.instance [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lazy-loading 'resources' on Instance uuid 0ac97670-dd82-4e3f-b34c-5d9be0e36501 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:01:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-348699316',display_name='tempest-TestServerVolumeAttachmentScenario-server-348699316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-348699316',id=31,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHB/HO6v0usJFTMl/+STMvOTQqnRVPtJd6JpPWstffTZJjmKOp6z8zts6TaVpLktO4j/MsDmSsK/QSo1fQTe2mq/yYA5eOTxJuPs922CfrDxGTudouNmQGpPqKAlFAYcQ==',key_name='tempest-keypair-1973740565',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:57:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d7981033f574199afbe602b19b81001',ramdisk_id='',reservation_id='r-dv5z0okc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1613470576',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1613470576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a576f0801b5e4b42bb58357d30a76ab7',uuid=0ac97670-dd82-4e3f-b34c-5d9be0e36501,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52696cfb-708d-41ac-9594-1591bc9df14c", "address": "fa:16:3e:f2:39:80", "network": {"id": "305f13a8-b1fe-4352-8ddb-457758bf97f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2115229939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d7981033f574199afbe602b19b81001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52696cfb-70", "ovs_interfaceid": "52696cfb-708d-41ac-9594-1591bc9df14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Converting VIF {"id": "52696cfb-708d-41ac-9594-1591bc9df14c", "address": "fa:16:3e:f2:39:80", "network": {"id": "305f13a8-b1fe-4352-8ddb-457758bf97f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2115229939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d7981033f574199afbe602b19b81001", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52696cfb-70", "ovs_interfaceid": "52696cfb-708d-41ac-9594-1591bc9df14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:39:80,bridge_name='br-int',has_traffic_filtering=True,id=52696cfb-708d-41ac-9594-1591bc9df14c,network=Network(305f13a8-b1fe-4352-8ddb-457758bf97f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52696cfb-70') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG os_vif [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:39:80,bridge_name='br-int',has_traffic_filtering=True,id=52696cfb-708d-41ac-9594-1591bc9df14c,network=Network(305f13a8-b1fe-4352-8ddb-457758bf97f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52696cfb-70') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52696cfb-70, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:45 user nova-compute[72990]: INFO os_vif [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:39:80,bridge_name='br-int',has_traffic_filtering=True,id=52696cfb-708d-41ac-9594-1591bc9df14c,network=Network(305f13a8-b1fe-4352-8ddb-457758bf97f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52696cfb-70')
Aug 27 04:01:45 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Deleting instance files /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501_del
Aug 27 04:01:45 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Deletion of /opt/stack/data/nova/instances/0ac97670-dd82-4e3f-b34c-5d9be0e36501_del complete
Aug 27 04:01:45 user nova-compute[72990]: INFO nova.compute.manager [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 27 04:01:45 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:46 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:01:46 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Took 1.40 seconds to deallocate network for instance.
Aug 27 04:01:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-8bf15d2e-13c3-490b-9d22-57d45849bb92 req-ed6bb3ea-581f-4005-a238-23a8a32e2179 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Received event network-vif-deleted-52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:01:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-318e5bcf-b997-46f9-81cb-911dfd393b0d req-ce2926ec-d714-46e7-ae6c-57c25256cda4 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Received event network-vif-plugged-52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:01:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-318e5bcf-b997-46f9-81cb-911dfd393b0d req-ce2926ec-d714-46e7-ae6c-57c25256cda4 service nova] Acquiring lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:01:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-318e5bcf-b997-46f9-81cb-911dfd393b0d req-ce2926ec-d714-46e7-ae6c-57c25256cda4 service nova] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:01:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-318e5bcf-b997-46f9-81cb-911dfd393b0d req-ce2926ec-d714-46e7-ae6c-57c25256cda4 service nova] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-318e5bcf-b997-46f9-81cb-911dfd393b0d req-ce2926ec-d714-46e7-ae6c-57c25256cda4 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] No waiting events found dispatching network-vif-plugged-52696cfb-708d-41ac-9594-1591bc9df14c {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:01:46 user nova-compute[72990]: WARNING nova.compute.manager [req-318e5bcf-b997-46f9-81cb-911dfd393b0d req-ce2926ec-d714-46e7-ae6c-57c25256cda4 service nova] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Received unexpected event network-vif-plugged-52696cfb-708d-41ac-9594-1591bc9df14c for instance with vm_state deleted and task_state None.
Aug 27 04:01:46 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:01:46 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:01:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:46 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Deleted allocations for instance 0ac97670-dd82-4e3f-b34c-5d9be0e36501
Aug 27 04:01:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8418a11f-09e9-42d4-bc35-26647b94637e tempest-TestServerVolumeAttachmentScenario-1613470576 tempest-TestServerVolumeAttachmentScenario-1613470576-project-member] Lock "0ac97670-dd82-4e3f-b34c-5d9be0e36501" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.893s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:01:47 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:01:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:01:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:01:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:01:47 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:01:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:47 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updating instance_info_cache with network_info: [{"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:01:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:01:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:01:48 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:01:48 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:01:48 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:01:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:01:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72990) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 04:01:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:56 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:01:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:01:59 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108904.9796474, 0ac97670-dd82-4e3f-b34c-5d9be0e36501 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:01:59 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] VM Stopped (Lifecycle Event)
Aug 27 04:02:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-1d6522b0-7b7c-44e2-a7b7-9bebbb8b81e7 None None] [instance: 0ac97670-dd82-4e3f-b34c-5d9be0e36501] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:02:00 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "ae9e24d9-20e5-4642-b6d3-de298c138730" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:02:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:06 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:02:06 user nova-compute[72990]: INFO nova.compute.claims [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Claim successful on node user
Aug 27 04:02:06 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:02:06 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:02:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:02:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:02:07 user nova-compute[72990]: DEBUG nova.network.neutron [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:02:07 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:02:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:02:07 user nova-compute[72990]: DEBUG nova.policy [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a2bca29600d4e3e8915894716b24bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2eb083c82b4dfcbad70f865367a84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:02:07 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:02:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:02:07 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Creating image(s)
Aug 27 04:02:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "/opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "/opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "e471bd42383ffc0a697bb6b1929507ecc4ae7323" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "e471bd42383ffc0a697bb6b1929507ecc4ae7323" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323.part --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG nova.network.neutron [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Successfully created port: 30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323.part --force-share --output=json" returned: 0 in 0.226s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG nova.virt.images [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] 495f4987-808e-4ba5-8d44-dad50c10e7a1 was qcow2, converting to raw {{(pid=72990) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323.part /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323.converted {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323.part /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323.converted" returned: 0 in 0.249s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323.converted --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "e471bd42383ffc0a697bb6b1929507ecc4ae7323" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.389s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323 --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "e471bd42383ffc0a697bb6b1929507ecc4ae7323" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "e471bd42383ffc0a697bb6b1929507ecc4ae7323" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG nova.network.neutron [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Successfully updated port: 30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "refresh_cache-ae9e24d9-20e5-4642-b6d3-de298c138730" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquired lock "refresh_cache-ae9e24d9-20e5-4642-b6d3-de298c138730" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG nova.network.neutron [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-52cb8217-14e9-4a06-b7e4-5b80566f7f34 req-2d3ddac9-87d8-4d9e-9116-db7d3805a683 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Received event network-changed-30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-52cb8217-14e9-4a06-b7e4-5b80566f7f34 req-2d3ddac9-87d8-4d9e-9116-db7d3805a683 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Refreshing instance network info cache due to event network-changed-30a7414a-b255-445a-bb41-1f2a6ab29b2b. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-52cb8217-14e9-4a06-b7e4-5b80566f7f34 req-2d3ddac9-87d8-4d9e-9116-db7d3805a683 service nova] Acquiring lock "refresh_cache-ae9e24d9-20e5-4642-b6d3-de298c138730" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG nova.network.neutron [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323 --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323,backing_fmt=raw /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323,backing_fmt=raw /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk 1073741824" returned: 0 in 0.048s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "e471bd42383ffc0a697bb6b1929507ecc4ae7323" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323 --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.network.neutron [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Updating instance_info_cache with network_info: [{"id": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "address": "fa:16:3e:8b:f2:b3", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a7414a-b2", "ovs_interfaceid": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Releasing lock "refresh_cache-ae9e24d9-20e5-4642-b6d3-de298c138730" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Instance network_info: |[{"id": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "address": "fa:16:3e:8b:f2:b3", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a7414a-b2", "ovs_interfaceid": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-52cb8217-14e9-4a06-b7e4-5b80566f7f34 req-2d3ddac9-87d8-4d9e-9116-db7d3805a683 service nova] Acquired lock "refresh_cache-ae9e24d9-20e5-4642-b6d3-de298c138730" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.network.neutron [req-52cb8217-14e9-4a06-b7e4-5b80566f7f34 req-2d3ddac9-87d8-4d9e-9116-db7d3805a683 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Refreshing network info cache for port 30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Cannot resize image /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Ensure instance console log exists: /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Start _get_guest_xml network_info=[{"id": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "address": "fa:16:3e:8b:f2:b3", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a7414a-b2", "ovs_interfaceid": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:02:03Z,direct_url=<?>,disk_format='qcow2',id=495f4987-808e-4ba5-8d44-dad50c10e7a1,min_disk=0,min_ram=0,name='tempest-scenario-img--352052414',owner='2b2eb083c82b4dfcbad70f865367a84a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:02:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': '495f4987-808e-4ba5-8d44-dad50c10e7a1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:02:09 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:02:09 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:02:03Z,direct_url=<?>,disk_format='qcow2',id=495f4987-808e-4ba5-8d44-dad50c10e7a1,min_disk=0,min_ram=0,name='tempest-scenario-img--352052414',owner='2b2eb083c82b4dfcbad70f865367a84a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:02:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-711638539',display_name='tempest-TestMinimumBasicScenario-server-711638539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-711638539',id=37,image_ref='495f4987-808e-4ba5-8d44-dad50c10e7a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxV9PIrZjpEjdaxZySrTj6+PXP0vwjtq61bBsDfK+SqYBGoC/25IJQhmR+2t1qRQJBqTXIbnMyvoKnElXpMQyZWmtnGGgX8JpudRt+7wCoythdqpVrCfP38n8oWU5eunw==',key_name='tempest-TestMinimumBasicScenario-2082822136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b2eb083c82b4dfcbad70f865367a84a',ramdisk_id='',reservation_id='r-fpcnh9i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='495f4987-808e-4ba5-8d44-dad50c10e7a1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1213348251',owner_user_name='tempest-TestMinimumBasicScenario-1213348251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:02:07Z,user_data=None,user_id='8a2bca29600d4e3e8915894716b24bdc',uuid=ae9e24d9-20e5-4642-b6d3-de298c138730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "address": "fa:16:3e:8b:f2:b3", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a7414a-b2", "ovs_interfaceid": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Converting VIF {"id": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "address": "fa:16:3e:8b:f2:b3", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a7414a-b2", "ovs_interfaceid": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f2:b3,bridge_name='br-int',has_traffic_filtering=True,id=30a7414a-b255-445a-bb41-1f2a6ab29b2b,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a7414a-b2') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.objects.instance [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lazy-loading 'pci_devices' on Instance uuid ae9e24d9-20e5-4642-b6d3-de298c138730 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:02:09 user nova-compute[72990]:   <uuid>ae9e24d9-20e5-4642-b6d3-de298c138730</uuid>
Aug 27 04:02:09 user nova-compute[72990]:   <name>instance-00000025</name>
Aug 27 04:02:09 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:02:09 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:02:09 user nova-compute[72990]:   <metadata>
Aug 27 04:02:09 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:02:09 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:02:09 user nova-compute[72990]:       <nova:name>tempest-TestMinimumBasicScenario-server-711638539</nova:name>
Aug 27 04:02:09 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:02:09</nova:creationTime>
Aug 27 04:02:09 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:02:09 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:02:09 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:02:09 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:02:09 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:02:09 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:02:09 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:02:09 user nova-compute[72990]:       <nova:owner>
Aug 27 04:02:09 user nova-compute[72990]:         <nova:user uuid="8a2bca29600d4e3e8915894716b24bdc">tempest-TestMinimumBasicScenario-1213348251-project-member</nova:user>
Aug 27 04:02:09 user nova-compute[72990]:         <nova:project uuid="2b2eb083c82b4dfcbad70f865367a84a">tempest-TestMinimumBasicScenario-1213348251</nova:project>
Aug 27 04:02:09 user nova-compute[72990]:       </nova:owner>
Aug 27 04:02:09 user nova-compute[72990]:       <nova:root type="image" uuid="495f4987-808e-4ba5-8d44-dad50c10e7a1"/>
Aug 27 04:02:09 user nova-compute[72990]:       <nova:ports>
Aug 27 04:02:09 user nova-compute[72990]:         <nova:port uuid="30a7414a-b255-445a-bb41-1f2a6ab29b2b">
Aug 27 04:02:09 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 04:02:09 user nova-compute[72990]:         </nova:port>
Aug 27 04:02:09 user nova-compute[72990]:       </nova:ports>
Aug 27 04:02:09 user nova-compute[72990]:     </nova:instance>
Aug 27 04:02:09 user nova-compute[72990]:   </metadata>
Aug 27 04:02:09 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:02:09 user nova-compute[72990]:     <system>
Aug 27 04:02:09 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:02:09 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:02:09 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:02:09 user nova-compute[72990]:       <entry name="serial">ae9e24d9-20e5-4642-b6d3-de298c138730</entry>
Aug 27 04:02:09 user nova-compute[72990]:       <entry name="uuid">ae9e24d9-20e5-4642-b6d3-de298c138730</entry>
Aug 27 04:02:09 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:02:09 user nova-compute[72990]:     </system>
Aug 27 04:02:09 user nova-compute[72990]:   </sysinfo>
Aug 27 04:02:09 user nova-compute[72990]:   <os>
Aug 27 04:02:09 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:02:09 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:02:09 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:02:09 user nova-compute[72990]:   </os>
Aug 27 04:02:09 user nova-compute[72990]:   <features>
Aug 27 04:02:09 user nova-compute[72990]:     <acpi/>
Aug 27 04:02:09 user nova-compute[72990]:     <apic/>
Aug 27 04:02:09 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:02:09 user nova-compute[72990]:   </features>
Aug 27 04:02:09 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:02:09 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:02:09 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:02:09 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:02:09 user nova-compute[72990]:   </clock>
Aug 27 04:02:09 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:02:09 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:02:09 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:02:09 user nova-compute[72990]:   </cpu>
Aug 27 04:02:09 user nova-compute[72990]:   <devices>
Aug 27 04:02:09 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:02:09 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:02:09 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk"/>
Aug 27 04:02:09 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:02:09 user nova-compute[72990]:     </disk>
Aug 27 04:02:09 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:02:09 user nova-compute[72990]:       <mac address="fa:16:3e:8b:f2:b3"/>
Aug 27 04:02:09 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:02:09 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:02:09 user nova-compute[72990]:       <target dev="tap30a7414a-b2"/>
Aug 27 04:02:09 user nova-compute[72990]:     </interface>
Aug 27 04:02:09 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:02:09 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/console.log" append="off"/>
Aug 27 04:02:09 user nova-compute[72990]:     </serial>
Aug 27 04:02:09 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:02:09 user nova-compute[72990]:     <video>
Aug 27 04:02:09 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:02:09 user nova-compute[72990]:     </video>
Aug 27 04:02:09 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:02:09 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:02:09 user nova-compute[72990]:     </rng>
Aug 27 04:02:09 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:02:09 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:02:09 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:02:09 user nova-compute[72990]:     </memballoon>
Aug 27 04:02:09 user nova-compute[72990]:   </devices>
Aug 27 04:02:09 user nova-compute[72990]: </domain>
Aug 27 04:02:09 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-711638539',display_name='tempest-TestMinimumBasicScenario-server-711638539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-711638539',id=37,image_ref='495f4987-808e-4ba5-8d44-dad50c10e7a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxV9PIrZjpEjdaxZySrTj6+PXP0vwjtq61bBsDfK+SqYBGoC/25IJQhmR+2t1qRQJBqTXIbnMyvoKnElXpMQyZWmtnGGgX8JpudRt+7wCoythdqpVrCfP38n8oWU5eunw==',key_name='tempest-TestMinimumBasicScenario-2082822136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b2eb083c82b4dfcbad70f865367a84a',ramdisk_id='',reservation_id='r-fpcnh9i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='495f4987-808e-4ba5-8d44-dad50c10e7a1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1213348251',owner_user_name='tempest-TestMinimumBasicScenario-1213348251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:02:07Z,user_data=None,user_id='8a2bca29600d4e3e8915894716b24bdc',uuid=ae9e24d9-20e5-4642-b6d3-de298c138730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "address": "fa:16:3e:8b:f2:b3", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a7414a-b2", "ovs_interfaceid": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Converting VIF {"id": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "address": "fa:16:3e:8b:f2:b3", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a7414a-b2", "ovs_interfaceid": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f2:b3,bridge_name='br-int',has_traffic_filtering=True,id=30a7414a-b255-445a-bb41-1f2a6ab29b2b,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a7414a-b2') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG os_vif [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f2:b3,bridge_name='br-int',has_traffic_filtering=True,id=30a7414a-b255-445a-bb41-1f2a6ab29b2b,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a7414a-b2') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30a7414a-b2, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30a7414a-b2, col_values=(('external_ids', {'iface-id': '30a7414a-b255-445a-bb41-1f2a6ab29b2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:f2:b3', 'vm-uuid': 'ae9e24d9-20e5-4642-b6d3-de298c138730'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:09 user nova-compute[72990]: INFO os_vif [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f2:b3,bridge_name='br-int',has_traffic_filtering=True,id=30a7414a-b255-445a-bb41-1f2a6ab29b2b,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a7414a-b2')
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] No VIF found with MAC fa:16:3e:8b:f2:b3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.network.neutron [req-52cb8217-14e9-4a06-b7e4-5b80566f7f34 req-2d3ddac9-87d8-4d9e-9116-db7d3805a683 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Updated VIF entry in instance network info cache for port 30a7414a-b255-445a-bb41-1f2a6ab29b2b. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG nova.network.neutron [req-52cb8217-14e9-4a06-b7e4-5b80566f7f34 req-2d3ddac9-87d8-4d9e-9116-db7d3805a683 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Updating instance_info_cache with network_info: [{"id": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "address": "fa:16:3e:8b:f2:b3", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a7414a-b2", "ovs_interfaceid": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:02:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-52cb8217-14e9-4a06-b7e4-5b80566f7f34 req-2d3ddac9-87d8-4d9e-9116-db7d3805a683 service nova] Releasing lock "refresh_cache-ae9e24d9-20e5-4642-b6d3-de298c138730" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:02:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-f50cada2-1789-45f3-80f5-4a9cdb1a80f9 req-e54c8134-3dba-409e-837a-a38b798c903d service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Received event network-vif-plugged-30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:02:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f50cada2-1789-45f3-80f5-4a9cdb1a80f9 req-e54c8134-3dba-409e-837a-a38b798c903d service nova] Acquiring lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f50cada2-1789-45f3-80f5-4a9cdb1a80f9 req-e54c8134-3dba-409e-837a-a38b798c903d service nova] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f50cada2-1789-45f3-80f5-4a9cdb1a80f9 req-e54c8134-3dba-409e-837a-a38b798c903d service nova] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-f50cada2-1789-45f3-80f5-4a9cdb1a80f9 req-e54c8134-3dba-409e-837a-a38b798c903d service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] No waiting events found dispatching network-vif-plugged-30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:02:11 user nova-compute[72990]: WARNING nova.compute.manager [req-f50cada2-1789-45f3-80f5-4a9cdb1a80f9 req-e54c8134-3dba-409e-837a-a38b798c903d service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Received unexpected event network-vif-plugged-30a7414a-b255-445a-bb41-1f2a6ab29b2b for instance with vm_state building and task_state spawning.
Aug 27 04:02:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108933.1432276, ae9e24d9-20e5-4642-b6d3-de298c138730 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:02:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] VM Resumed (Lifecycle Event)
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:02:13 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Instance spawned successfully.
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:02:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108933.145361, ae9e24d9-20e5-4642-b6d3-de298c138730 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:02:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] VM Started (Lifecycle Event)
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:02:13 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:02:13 user nova-compute[72990]: INFO nova.compute.manager [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-0735537e-4c4d-43a3-b48f-964fec9f19bb req-57d8cf70-6fa0-4fd8-8c71-b6deeea46080 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Received event network-vif-plugged-30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0735537e-4c4d-43a3-b48f-964fec9f19bb req-57d8cf70-6fa0-4fd8-8c71-b6deeea46080 service nova] Acquiring lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0735537e-4c4d-43a3-b48f-964fec9f19bb req-57d8cf70-6fa0-4fd8-8c71-b6deeea46080 service nova] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0735537e-4c4d-43a3-b48f-964fec9f19bb req-57d8cf70-6fa0-4fd8-8c71-b6deeea46080 service nova] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-0735537e-4c4d-43a3-b48f-964fec9f19bb req-57d8cf70-6fa0-4fd8-8c71-b6deeea46080 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] No waiting events found dispatching network-vif-plugged-30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:02:13 user nova-compute[72990]: WARNING nova.compute.manager [req-0735537e-4c4d-43a3-b48f-964fec9f19bb req-57d8cf70-6fa0-4fd8-8c71-b6deeea46080 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Received unexpected event network-vif-plugged-30a7414a-b255-445a-bb41-1f2a6ab29b2b for instance with vm_state building and task_state spawning.
Aug 27 04:02:13 user nova-compute[72990]: INFO nova.compute.manager [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Took 6.84 seconds to build instance.
Aug 27 04:02:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8ede033b-6cd1-4f55-aa1d-490dc52e5fdf tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.937s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "f8dca40d-3064-41ae-9374-6aefe9f2b941" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG nova.objects.instance [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquired lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG nova.objects.instance [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'info_cache' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG nova.objects.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:02:22 user nova-compute[72990]: INFO nova.compute.claims [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Claim successful on node user
Aug 27 04:02:22 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updating instance_info_cache with network_info: [{"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:02:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Releasing lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:02:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance destroyed successfully.
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.objects.instance [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'resources' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.objects.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache,resources {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1823636413',display_name='tempest-AttachVolumeTestJSON-server-1823636413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1823636413',id=32,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZNGdZSsfPtAguFJDKN3iVgvVi0aLXdyqROhiDmpQVPMLbPrj6LNqo6zh2eRkFzKq35WCkDJ3pahxf33JmxUgZuGyUraQp1NA3CDVXGmGeP0bYPK2BVWcRuq13QnqVJqg==',key_name='tempest-keypair-1602283704',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:58:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e2d0a8267a0042a0ad831e7b91889dc7',ramdisk_id='',reservation_id='r-2qv66d4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-698620353',owner_user_name='tempest-AttachVolumeTestJSON-698620353-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5711f5c9c8344de79b246e7eb8661ff2',uuid=aef3be9a-fd69-4428-97c3-1016d97ca0e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converting VIF {"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_vif [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35d5b0ac-30, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:02:23 user nova-compute[72990]: INFO os_vif [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30')
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAMHsEcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:02:23 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.policy [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf3112e616344af7873a50d134260637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6b19a372f947e4aee43f9d7573e8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: INFO nova.virt.block_device [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Booting with volume snapshot fe0043b2-ba75-45f3-962f-1c91613a9694 at /dev/vda
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b50ba1-216d-4d67-9b84-5cc081653c73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7a5cfd-6ed7-427d-9696-9880ac523d1b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:02:23 user nova-compute[72990]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:02:23 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:02:23 user nova-compute[72990]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:02:23 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4433c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[84571f43-1d49-440c-8349-865a28ac7628]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b30c24-662c-4850-b0f4-63e74273038e]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8e864f-ed93-4874-a992-1ce9783002a2]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[34718bdc-f8ec-47b6-817e-252f3c55ce9f]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[727c65b8-6f3e-4eda-801c-c9d6ae9a9168]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3818b2fa-27aa-4d81-bc78-975b34fd18e2]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260]
Aug 27 04:02:23 user nova-compute[72990]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260] successful.
Aug 27 04:02:23 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f81871e-3660-4843-ba2d-a356fd9de53d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] <== disconnect_volume: return (308ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Start _get_guest_xml network_info=[{"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '4bcb21d0-b60c-4ee0-8189-3f05f0d5cc14', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAMHsEcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'aef3be9a-fd69-4428-97c3-1016d97ca0e9', 'attached_at': '', 'detached_at': '', 'volume_id': '2dc92d69-6572-4583-94d4-fb25f5eb3714', 'serial': '2dc92d69-6572-4583-94d4-fb25f5eb3714'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.objects.instance [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'numa_topology' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.objects.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:02:23 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:02:23 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.objects.instance [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'vcpu_model' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.objects.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAMHsEcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:02:23 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:02:23 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:02:23 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c337e98-cb3b-485f-9204-08a3e00cf4e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:02:23 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab270484-bb70-4bf0-a83d-ae3415f8e5a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714] added
Aug 27 04:02:23 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab57477-58c6-4ff7-8ac1-302e7a4af7bc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b88d22-4ceb-4570-a30c-2f42d9ed78db]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CAMHsEcm {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CAMHsEcm" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c64e3bc-0dc9-4f11-9166-d1c534a1dcee]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CAMHsEcm'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daf5c9f-c3e7-4c9f-b43a-3fdd04a62f74]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c568c6b2-684e-4659-8eac-967cd39d797e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:02:23 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:02:23 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Successfully created port: 0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af9d536-c012-4302-87bb-155d41f41a82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260]
Aug 27 04:02:23 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260] successful.
Aug 27 04:02:23 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.147s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[686fa9b4-94e4-4713-8fc6-9ee75983231c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[37123513-afc5-42a9-8c24-53d0145cd08b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:02:24 user nova-compute[72990]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:02:24 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:02:24 user nova-compute[72990]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:02:24 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.451s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef3c79b-63b2-42f5-9767-41f2c16b7167]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAMHsEcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG nova.network.neutron [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Successfully updated port: 0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "refresh_cache-f8dca40d-3064-41ae-9374-6aefe9f2b941" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquired lock "refresh_cache-f8dca40d-3064-41ae-9374-6aefe9f2b941" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG nova.network.neutron [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG nova.compute.manager [req-748a6ead-24f3-4506-b00c-e67669a20cac req-24664156-65bb-4685-b318-3fd159fccc6e service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Received event network-changed-0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG nova.compute.manager [req-748a6ead-24f3-4506-b00c-e67669a20cac req-24664156-65bb-4685-b318-3fd159fccc6e service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Refreshing instance network info cache due to event network-changed-0364cc8c-227a-4464-8c2b-9a04f24c568f. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-748a6ead-24f3-4506-b00c-e67669a20cac req-24664156-65bb-4685-b318-3fd159fccc6e service nova] Acquiring lock "refresh_cache-f8dca40d-3064-41ae-9374-6aefe9f2b941" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:02:24 user nova-compute[72990]: DEBUG nova.network.neutron [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Updating instance_info_cache with network_info: [{"id": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "address": "fa:16:3e:b5:9a:06", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0364cc8c-22", "ovs_interfaceid": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Releasing lock "refresh_cache-f8dca40d-3064-41ae-9374-6aefe9f2b941" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Instance network_info: |[{"id": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "address": "fa:16:3e:b5:9a:06", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0364cc8c-22", "ovs_interfaceid": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-748a6ead-24f3-4506-b00c-e67669a20cac req-24664156-65bb-4685-b318-3fd159fccc6e service nova] Acquired lock "refresh_cache-f8dca40d-3064-41ae-9374-6aefe9f2b941" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.network.neutron [req-748a6ead-24f3-4506-b00c-e67669a20cac req-24664156-65bb-4685-b318-3fd159fccc6e service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Refreshing network info cache for port 0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.498s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] <== connect_volume: return (1499ms) {'type': 'block', 'scsi_wwn': '23435353435383932', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435353435383932', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1823636413',display_name='tempest-AttachVolumeTestJSON-server-1823636413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1823636413',id=32,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZNGdZSsfPtAguFJDKN3iVgvVi0aLXdyqROhiDmpQVPMLbPrj6LNqo6zh2eRkFzKq35WCkDJ3pahxf33JmxUgZuGyUraQp1NA3CDVXGmGeP0bYPK2BVWcRuq13QnqVJqg==',key_name='tempest-keypair-1602283704',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:58:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e2d0a8267a0042a0ad831e7b91889dc7',ramdisk_id='',reservation_id='r-2qv66d4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-698620353',owner_user_name='tempest-AttachVolumeTestJSON-698620353-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5711f5c9c8344de79b246e7eb8661ff2',uuid=aef3be9a-fd69-4428-97c3-1016d97ca0e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converting VIF {"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.objects.instance [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'pci_devices' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.objects.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:02:25 user nova-compute[72990]:   <uuid>aef3be9a-fd69-4428-97c3-1016d97ca0e9</uuid>
Aug 27 04:02:25 user nova-compute[72990]:   <name>instance-00000020</name>
Aug 27 04:02:25 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:02:25 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:02:25 user nova-compute[72990]:   <metadata>
Aug 27 04:02:25 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:02:25 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:02:25 user nova-compute[72990]:       <nova:name>tempest-AttachVolumeTestJSON-server-1823636413</nova:name>
Aug 27 04:02:25 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:02:23</nova:creationTime>
Aug 27 04:02:25 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:02:25 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:02:25 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:02:25 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:02:25 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:02:25 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:02:25 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:02:25 user nova-compute[72990]:       <nova:owner>
Aug 27 04:02:25 user nova-compute[72990]:         <nova:user uuid="5711f5c9c8344de79b246e7eb8661ff2">tempest-AttachVolumeTestJSON-698620353-project-member</nova:user>
Aug 27 04:02:25 user nova-compute[72990]:         <nova:project uuid="e2d0a8267a0042a0ad831e7b91889dc7">tempest-AttachVolumeTestJSON-698620353</nova:project>
Aug 27 04:02:25 user nova-compute[72990]:       </nova:owner>
Aug 27 04:02:25 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 04:02:25 user nova-compute[72990]:       <nova:ports>
Aug 27 04:02:25 user nova-compute[72990]:         <nova:port uuid="35d5b0ac-308b-4a82-a29d-63bbe0c8ab70">
Aug 27 04:02:25 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 04:02:25 user nova-compute[72990]:         </nova:port>
Aug 27 04:02:25 user nova-compute[72990]:       </nova:ports>
Aug 27 04:02:25 user nova-compute[72990]:     </nova:instance>
Aug 27 04:02:25 user nova-compute[72990]:   </metadata>
Aug 27 04:02:25 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:02:25 user nova-compute[72990]:     <system>
Aug 27 04:02:25 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:02:25 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:02:25 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:02:25 user nova-compute[72990]:       <entry name="serial">aef3be9a-fd69-4428-97c3-1016d97ca0e9</entry>
Aug 27 04:02:25 user nova-compute[72990]:       <entry name="uuid">aef3be9a-fd69-4428-97c3-1016d97ca0e9</entry>
Aug 27 04:02:25 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:02:25 user nova-compute[72990]:     </system>
Aug 27 04:02:25 user nova-compute[72990]:   </sysinfo>
Aug 27 04:02:25 user nova-compute[72990]:   <os>
Aug 27 04:02:25 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:02:25 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:02:25 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:02:25 user nova-compute[72990]:   </os>
Aug 27 04:02:25 user nova-compute[72990]:   <features>
Aug 27 04:02:25 user nova-compute[72990]:     <acpi/>
Aug 27 04:02:25 user nova-compute[72990]:     <apic/>
Aug 27 04:02:25 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:02:25 user nova-compute[72990]:   </features>
Aug 27 04:02:25 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:02:25 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:02:25 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:02:25 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:02:25 user nova-compute[72990]:   </clock>
Aug 27 04:02:25 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:02:25 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:02:25 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:02:25 user nova-compute[72990]:   </cpu>
Aug 27 04:02:25 user nova-compute[72990]:   <devices>
Aug 27 04:02:25 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:02:25 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:02:25 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk"/>
Aug 27 04:02:25 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:02:25 user nova-compute[72990]:     </disk>
Aug 27 04:02:25 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 04:02:25 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:02:25 user nova-compute[72990]:       <source dev="/dev/sdb"/>
Aug 27 04:02:25 user nova-compute[72990]:       <target dev="vdb" bus="virtio"/>
Aug 27 04:02:25 user nova-compute[72990]:       <serial>2dc92d69-6572-4583-94d4-fb25f5eb3714</serial>
Aug 27 04:02:25 user nova-compute[72990]:     </disk>
Aug 27 04:02:25 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:02:25 user nova-compute[72990]:       <mac address="fa:16:3e:dc:26:ce"/>
Aug 27 04:02:25 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:02:25 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:02:25 user nova-compute[72990]:       <target dev="tap35d5b0ac-30"/>
Aug 27 04:02:25 user nova-compute[72990]:     </interface>
Aug 27 04:02:25 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:02:25 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/console.log" append="off"/>
Aug 27 04:02:25 user nova-compute[72990]:     </serial>
Aug 27 04:02:25 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:02:25 user nova-compute[72990]:     <video>
Aug 27 04:02:25 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:02:25 user nova-compute[72990]:     </video>
Aug 27 04:02:25 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:02:25 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:02:25 user nova-compute[72990]:     </rng>
Aug 27 04:02:25 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:02:25 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:02:25 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:02:25 user nova-compute[72990]:     </memballoon>
Aug 27 04:02:25 user nova-compute[72990]:   </devices>
Aug 27 04:02:25 user nova-compute[72990]: </domain>
Aug 27 04:02:25 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.network.neutron [req-748a6ead-24f3-4506-b00c-e67669a20cac req-24664156-65bb-4685-b318-3fd159fccc6e service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Updated VIF entry in instance network info cache for port 0364cc8c-227a-4464-8c2b-9a04f24c568f. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.network.neutron [req-748a6ead-24f3-4506-b00c-e67669a20cac req-24664156-65bb-4685-b318-3fd159fccc6e service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Updating instance_info_cache with network_info: [{"id": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "address": "fa:16:3e:b5:9a:06", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0364cc8c-22", "ovs_interfaceid": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.objects.instance [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'trusted_certs' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-748a6ead-24f3-4506-b00c-e67669a20cac req-24664156-65bb-4685-b318-3fd159fccc6e service nova] Releasing lock "refresh_cache-f8dca40d-3064-41ae-9374-6aefe9f2b941" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.objects.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Cannot resize image /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.objects.instance [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'migration_context' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.objects.base [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1823636413',display_name='tempest-AttachVolumeTestJSON-server-1823636413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1823636413',id=32,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZNGdZSsfPtAguFJDKN3iVgvVi0aLXdyqROhiDmpQVPMLbPrj6LNqo6zh2eRkFzKq35WCkDJ3pahxf33JmxUgZuGyUraQp1NA3CDVXGmGeP0bYPK2BVWcRuq13QnqVJqg==',key_name='tempest-keypair-1602283704',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:58:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e2d0a8267a0042a0ad831e7b91889dc7',ramdisk_id='',reservation_id='r-2qv66d4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-698620353',owner_user_name='tempest-AttachVolumeTestJSON-698620353-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5711f5c9c8344de79b246e7eb8661ff2',uuid=aef3be9a-fd69-4428-97c3-1016d97ca0e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converting VIF {"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG os_vif [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35d5b0ac-30, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35d5b0ac-30, col_values=(('external_ids', {'iface-id': '35d5b0ac-308b-4a82-a29d-63bbe0c8ab70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:26:ce', 'vm-uuid': 'aef3be9a-fd69-4428-97c3-1016d97ca0e9'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:02:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:25 user nova-compute[72990]: INFO os_vif [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30')
Aug 27 04:02:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-fcdb057b-b24f-42d1-8474-c0936de095a8 req-4de9dae5-3cb6-4177-a57a-13e720a229e0 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:02:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fcdb057b-b24f-42d1-8474-c0936de095a8 req-4de9dae5-3cb6-4177-a57a-13e720a229e0 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fcdb057b-b24f-42d1-8474-c0936de095a8 req-4de9dae5-3cb6-4177-a57a-13e720a229e0 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fcdb057b-b24f-42d1-8474-c0936de095a8 req-4de9dae5-3cb6-4177-a57a-13e720a229e0 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-fcdb057b-b24f-42d1-8474-c0936de095a8 req-4de9dae5-3cb6-4177-a57a-13e720a229e0 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:02:27 user nova-compute[72990]: WARNING nova.compute.manager [req-fcdb057b-b24f-42d1-8474-c0936de095a8 req-4de9dae5-3cb6-4177-a57a-13e720a229e0 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state stopped and task_state powering-on.
Aug 27 04:02:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG os_brick.utils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf07127e-9c14-4f2e-9ff8-15cffed370c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34d72fb-7f0c-4e2f-a2cc-e7c35f6788a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c077f12f-7661-4b32-8522-7d72b0d4bf61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f836ddcd-fadb-4e8a-8ea0-3460e605113a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:02:29 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:02:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5425309-6dfa-4dae-927b-970ad7599a9f]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG os_brick.utils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Updating existing volume attachment record: c0cecd6c-5b82-4d8b-a182-491fd5c293ad {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108949.417423, aef3be9a-fd69-4428-97c3-1016d97ca0e9 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:02:29 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] VM Resumed (Lifecycle Event)
Aug 27 04:02:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:02:29 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance rebooted successfully.
Aug 27 04:02:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7133735b-168e-4c74-9253-97527be70df0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:02:29 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 27 04:02:29 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108949.4271977, aef3be9a-fd69-4428-97c3-1016d97ca0e9 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:02:29 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] VM Started (Lifecycle Event)
Aug 27 04:02:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-910f284f-72f6-4eea-b42d-a33721503042 req-33795fc2-91dc-45db-9f0f-be328cdcbfc4 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-910f284f-72f6-4eea-b42d-a33721503042 req-33795fc2-91dc-45db-9f0f-be328cdcbfc4 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-910f284f-72f6-4eea-b42d-a33721503042 req-33795fc2-91dc-45db-9f0f-be328cdcbfc4 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-910f284f-72f6-4eea-b42d-a33721503042 req-33795fc2-91dc-45db-9f0f-be328cdcbfc4 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-910f284f-72f6-4eea-b42d-a33721503042 req-33795fc2-91dc-45db-9f0f-be328cdcbfc4 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:02:29 user nova-compute[72990]: WARNING nova.compute.manager [req-910f284f-72f6-4eea-b42d-a33721503042 req-33795fc2-91dc-45db-9f0f-be328cdcbfc4 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state stopped and task_state powering-on.
Aug 27 04:02:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:02:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:02:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:30 user nova-compute[72990]: INFO nova.compute.manager [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Terminating instance
Aug 27 04:02:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:02:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:31 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Instance destroyed successfully.
Aug 27 04:02:31 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lazy-loading 'resources' on Instance uuid 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:00:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1405406236',display_name='tempest-ServersNegativeTestJSON-server-1405406236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1405406236',id=34,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dabbdf88ca1498c95e36398ee38985a',ramdisk_id='',reservation_id='r-t2t0c0o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1760637283',owner_user_name='tempest-ServersNegativeTestJSON-1760637283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:00:48Z,user_data=None,user_id='d5cb3e0b98574319ac56c76cc1d0a796',uuid=5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "869f225f-e1cf-4188-af5e-0889efd60c23", "address": "fa:16:3e:5a:ab:c9", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869f225f-e1", "ovs_interfaceid": "869f225f-e1cf-4188-af5e-0889efd60c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Converting VIF {"id": "869f225f-e1cf-4188-af5e-0889efd60c23", "address": "fa:16:3e:5a:ab:c9", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869f225f-e1", "ovs_interfaceid": "869f225f-e1cf-4188-af5e-0889efd60c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ab:c9,bridge_name='br-int',has_traffic_filtering=True,id=869f225f-e1cf-4188-af5e-0889efd60c23,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869f225f-e1') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG os_vif [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ab:c9,bridge_name='br-int',has_traffic_filtering=True,id=869f225f-e1cf-4188-af5e-0889efd60c23,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869f225f-e1') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-f0772537-745a-4b53-998f-30ab0f4d5321 req-e7188b28-782c-484a-9ca7-692eeb009c33 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Received event network-vif-unplugged-869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f0772537-745a-4b53-998f-30ab0f4d5321 req-e7188b28-782c-484a-9ca7-692eeb009c33 service nova] Acquiring lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f0772537-745a-4b53-998f-30ab0f4d5321 req-e7188b28-782c-484a-9ca7-692eeb009c33 service nova] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f0772537-745a-4b53-998f-30ab0f4d5321 req-e7188b28-782c-484a-9ca7-692eeb009c33 service nova] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-f0772537-745a-4b53-998f-30ab0f4d5321 req-e7188b28-782c-484a-9ca7-692eeb009c33 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] No waiting events found dispatching network-vif-unplugged-869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-f0772537-745a-4b53-998f-30ab0f4d5321 req-e7188b28-782c-484a-9ca7-692eeb009c33 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Received event network-vif-unplugged-869f225f-e1cf-4188-af5e-0889efd60c23 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-f0772537-745a-4b53-998f-30ab0f4d5321 req-e7188b28-782c-484a-9ca7-692eeb009c33 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Received event network-vif-plugged-869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f0772537-745a-4b53-998f-30ab0f4d5321 req-e7188b28-782c-484a-9ca7-692eeb009c33 service nova] Acquiring lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f0772537-745a-4b53-998f-30ab0f4d5321 req-e7188b28-782c-484a-9ca7-692eeb009c33 service nova] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f0772537-745a-4b53-998f-30ab0f4d5321 req-e7188b28-782c-484a-9ca7-692eeb009c33 service nova] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-f0772537-745a-4b53-998f-30ab0f4d5321 req-e7188b28-782c-484a-9ca7-692eeb009c33 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] No waiting events found dispatching network-vif-plugged-869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:02:31 user nova-compute[72990]: WARNING nova.compute.manager [req-f0772537-745a-4b53-998f-30ab0f4d5321 req-e7188b28-782c-484a-9ca7-692eeb009c33 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Received unexpected event network-vif-plugged-869f225f-e1cf-4188-af5e-0889efd60c23 for instance with vm_state active and task_state deleting.
Aug 27 04:02:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap869f225f-e1, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:02:31 user nova-compute[72990]: INFO os_vif [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ab:c9,bridge_name='br-int',has_traffic_filtering=True,id=869f225f-e1cf-4188-af5e-0889efd60c23,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869f225f-e1')
Aug 27 04:02:31 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Deleting instance files /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8_del
Aug 27 04:02:31 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Deletion of /opt/stack/data/nova/instances/5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8_del complete
Aug 27 04:02:31 user nova-compute[72990]: INFO nova.compute.manager [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 27 04:02:31 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:02:31 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:02:32 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:02:32 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Took 0.55 seconds to deallocate network for instance.
Aug 27 04:02:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:32 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:02:32 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:02:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:32 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Deleted allocations for instance 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8
Aug 27 04:02:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5abea97-fbf0-4d2c-98ab-5e81f2498b59 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.958s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-62347782-2df0-4076-8e36-e95ef9b05d50 req-8e5b424a-54e1-404f-91d0-83b847bd8c13 service nova] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Received event network-vif-deleted-869f225f-e1cf-4188-af5e-0889efd60c23 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:02:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:02:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:40 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:02:40 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:02:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:02:40 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:02:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:40 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:02:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:02:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:02:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:02:43 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7864MB free_disk=25.034297943115234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7835f781-b543-4370-922b-3d2a76f9821b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance fa2cafdb-77ef-4d45-8523-c29c2a258475 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance eeaea5e8-16c9-4a0d-b296-e883311331ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ae9e24d9-20e5-4642-b6d3-de298c138730 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance f8dca40d-3064-41ae-9374-6aefe9f2b941 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:02:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:44 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:02:44 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:02:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:02:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:02:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:02:44 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:02:45 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Updating instance_info_cache with network_info: [{"id": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "address": "fa:16:3e:32:2f:f1", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe52f47f-bf", "ovs_interfaceid": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:02:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:02:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:02:45 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:02:45 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:02:45 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:02:46 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:02:46 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108951.5076168, 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:02:46 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] VM Stopped (Lifecycle Event)
Aug 27 04:02:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-011cb7bb-34b4-4791-9672-03c5b00a0e5a None None] [instance: 5b8b0e92-5651-4e3e-afd7-9fdc54a1c7a8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:02:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:02:47 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Creating image(s)
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Ensure instance console log exists: /opt/stack/data/nova/instances/f8dca40d-3064-41ae-9374-6aefe9f2b941/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Start _get_guest_xml network_info=[{"id": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "address": "fa:16:3e:b5:9a:06", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0364cc8c-22", "ovs_interfaceid": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'c0cecd6c-5b82-4d8b-a182-491fd5c293ad', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdSGItVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f8dca40d-3064-41ae-9374-6aefe9f2b941', 'attached_at': '', 'detached_at': '', 'volume_id': '59f9b27c-e18f-4f91-991c-c5799681cdc2', 'serial': '59f9b27c-e18f-4f91-991c-c5799681cdc2'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:02:47 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:02:47 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdSGItVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:02:47 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:02:47 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:02:47 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb79f4c7-81b3-41aa-a100-3d40228e3c89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:02:47 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9204e3-483a-4c1d-bdff-e2a3d8cbcd9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2] added
Aug 27 04:02:47 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3479a7a7-afe6-49eb-87f0-fadfa538a248]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6756488-a3a8-43bc-b150-b1bd54745005]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sdSGItVE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sdSGItVE" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34ff843-b148-41ca-9bf3-5022c9881a31]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sdSGItVE'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd346e1-a2a4-4055-a0bd-cb469e0432e7]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbe9e37-59b8-4625-a4bf-22ae710d2043]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:02:47 user nova-compute[72990]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:02:47 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:02:47 user nova-compute[72990]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:02:47 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c491fb-b7d8-4925-ab4d-a7404e4870f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2, portal: 172.16.0.220,3260]
Aug 27 04:02:47 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2, portal: 172.16.0.220,3260] successful.
Aug 27 04:02:47 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10e201c-27fa-44e4-b45a-aa63dd20a82b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0271811-2e5a-44f1-8d91-78ee78ba50ff]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:02:47 user nova-compute[72990]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:02:47 user nova-compute[72990]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)
Aug 27 04:02:47 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:02:47 user nova-compute[72990]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:02:47 user nova-compute[72990]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)
Aug 27 04:02:47 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebce52b-f3b8-4c6b-a22f-f050f85777f9]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdSGItVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:02:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23532303164363337', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532303164363337', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1902593521',display_name='tempest-TestVolumeBootPattern-server-1902593521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1902593521',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-ky023p0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:02:23Z,user_data=None,user_id='cf3112e616344af7873a50d134260637',uuid=f8dca40d-3064-41ae-9374-6aefe9f2b941,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "address": "fa:16:3e:b5:9a:06", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0364cc8c-22", "ovs_interfaceid": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "address": "fa:16:3e:b5:9a:06", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0364cc8c-22", "ovs_interfaceid": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=0364cc8c-227a-4464-8c2b-9a04f24c568f,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0364cc8c-22') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lazy-loading 'pci_devices' on Instance uuid f8dca40d-3064-41ae-9374-6aefe9f2b941 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:02:48 user nova-compute[72990]:   <uuid>f8dca40d-3064-41ae-9374-6aefe9f2b941</uuid>
Aug 27 04:02:48 user nova-compute[72990]:   <name>instance-00000026</name>
Aug 27 04:02:48 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:02:48 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:02:48 user nova-compute[72990]:   <metadata>
Aug 27 04:02:48 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:02:48 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:02:48 user nova-compute[72990]:       <nova:name>tempest-TestVolumeBootPattern-server-1902593521</nova:name>
Aug 27 04:02:48 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:02:47</nova:creationTime>
Aug 27 04:02:48 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:02:48 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:02:48 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:02:48 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:02:48 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:02:48 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:02:48 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:02:48 user nova-compute[72990]:       <nova:owner>
Aug 27 04:02:48 user nova-compute[72990]:         <nova:user uuid="cf3112e616344af7873a50d134260637">tempest-TestVolumeBootPattern-1834919775-project-member</nova:user>
Aug 27 04:02:48 user nova-compute[72990]:         <nova:project uuid="6d6b19a372f947e4aee43f9d7573e8f7">tempest-TestVolumeBootPattern-1834919775</nova:project>
Aug 27 04:02:48 user nova-compute[72990]:       </nova:owner>
Aug 27 04:02:48 user nova-compute[72990]:       <nova:ports>
Aug 27 04:02:48 user nova-compute[72990]:         <nova:port uuid="0364cc8c-227a-4464-8c2b-9a04f24c568f">
Aug 27 04:02:48 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 04:02:48 user nova-compute[72990]:         </nova:port>
Aug 27 04:02:48 user nova-compute[72990]:       </nova:ports>
Aug 27 04:02:48 user nova-compute[72990]:     </nova:instance>
Aug 27 04:02:48 user nova-compute[72990]:   </metadata>
Aug 27 04:02:48 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:02:48 user nova-compute[72990]:     <system>
Aug 27 04:02:48 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:02:48 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:02:48 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:02:48 user nova-compute[72990]:       <entry name="serial">f8dca40d-3064-41ae-9374-6aefe9f2b941</entry>
Aug 27 04:02:48 user nova-compute[72990]:       <entry name="uuid">f8dca40d-3064-41ae-9374-6aefe9f2b941</entry>
Aug 27 04:02:48 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:02:48 user nova-compute[72990]:     </system>
Aug 27 04:02:48 user nova-compute[72990]:   </sysinfo>
Aug 27 04:02:48 user nova-compute[72990]:   <os>
Aug 27 04:02:48 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:02:48 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:02:48 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:02:48 user nova-compute[72990]:   </os>
Aug 27 04:02:48 user nova-compute[72990]:   <features>
Aug 27 04:02:48 user nova-compute[72990]:     <acpi/>
Aug 27 04:02:48 user nova-compute[72990]:     <apic/>
Aug 27 04:02:48 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:02:48 user nova-compute[72990]:   </features>
Aug 27 04:02:48 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:02:48 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:02:48 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:02:48 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:02:48 user nova-compute[72990]:   </clock>
Aug 27 04:02:48 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:02:48 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:02:48 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:02:48 user nova-compute[72990]:   </cpu>
Aug 27 04:02:48 user nova-compute[72990]:   <devices>
Aug 27 04:02:48 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 04:02:48 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:02:48 user nova-compute[72990]:       <source dev="/dev/sdc"/>
Aug 27 04:02:48 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:02:48 user nova-compute[72990]:       <serial>59f9b27c-e18f-4f91-991c-c5799681cdc2</serial>
Aug 27 04:02:48 user nova-compute[72990]:     </disk>
Aug 27 04:02:48 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:02:48 user nova-compute[72990]:       <mac address="fa:16:3e:b5:9a:06"/>
Aug 27 04:02:48 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:02:48 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:02:48 user nova-compute[72990]:       <target dev="tap0364cc8c-22"/>
Aug 27 04:02:48 user nova-compute[72990]:     </interface>
Aug 27 04:02:48 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:02:48 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/f8dca40d-3064-41ae-9374-6aefe9f2b941/console.log" append="off"/>
Aug 27 04:02:48 user nova-compute[72990]:     </serial>
Aug 27 04:02:48 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:02:48 user nova-compute[72990]:     <video>
Aug 27 04:02:48 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:02:48 user nova-compute[72990]:     </video>
Aug 27 04:02:48 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:02:48 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:02:48 user nova-compute[72990]:     </rng>
Aug 27 04:02:48 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:02:48 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:02:48 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:02:48 user nova-compute[72990]:     </memballoon>
Aug 27 04:02:48 user nova-compute[72990]:   </devices>
Aug 27 04:02:48 user nova-compute[72990]: </domain>
Aug 27 04:02:48 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1902593521',display_name='tempest-TestVolumeBootPattern-server-1902593521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1902593521',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-ky023p0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:02:23Z,user_data=None,user_id='cf3112e616344af7873a50d134260637',uuid=f8dca40d-3064-41ae-9374-6aefe9f2b941,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "address": "fa:16:3e:b5:9a:06", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0364cc8c-22", "ovs_interfaceid": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "address": "fa:16:3e:b5:9a:06", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0364cc8c-22", "ovs_interfaceid": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=0364cc8c-227a-4464-8c2b-9a04f24c568f,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0364cc8c-22') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG os_vif [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=0364cc8c-227a-4464-8c2b-9a04f24c568f,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0364cc8c-22') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0364cc8c-22, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0364cc8c-22, col_values=(('external_ids', {'iface-id': '0364cc8c-227a-4464-8c2b-9a04f24c568f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:9a:06', 'vm-uuid': 'f8dca40d-3064-41ae-9374-6aefe9f2b941'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:48 user nova-compute[72990]: INFO os_vif [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=0364cc8c-227a-4464-8c2b-9a04f24c568f,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0364cc8c-22')
Aug 27 04:02:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:02:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] No VIF found with MAC fa:16:3e:b5:9a:06, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:02:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-bc6071c3-6796-46f9-8fc7-45b15124fe53 req-653a99e8-9df1-41e4-93d2-32afc90e76c8 service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Received event network-vif-plugged-0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:02:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bc6071c3-6796-46f9-8fc7-45b15124fe53 req-653a99e8-9df1-41e4-93d2-32afc90e76c8 service nova] Acquiring lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bc6071c3-6796-46f9-8fc7-45b15124fe53 req-653a99e8-9df1-41e4-93d2-32afc90e76c8 service nova] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bc6071c3-6796-46f9-8fc7-45b15124fe53 req-653a99e8-9df1-41e4-93d2-32afc90e76c8 service nova] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-bc6071c3-6796-46f9-8fc7-45b15124fe53 req-653a99e8-9df1-41e4-93d2-32afc90e76c8 service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] No waiting events found dispatching network-vif-plugged-0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:02:50 user nova-compute[72990]: WARNING nova.compute.manager [req-bc6071c3-6796-46f9-8fc7-45b15124fe53 req-653a99e8-9df1-41e4-93d2-32afc90e76c8 service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Received unexpected event network-vif-plugged-0364cc8c-227a-4464-8c2b-9a04f24c568f for instance with vm_state building and task_state spawning.
Aug 27 04:02:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.compute.manager [req-edea9f86-2417-4721-b549-adcb6ab36766 req-161418d6-0006-42e5-8bda-4262c5bbfb63 service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Received event network-vif-plugged-0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-edea9f86-2417-4721-b549-adcb6ab36766 req-161418d6-0006-42e5-8bda-4262c5bbfb63 service nova] Acquiring lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-edea9f86-2417-4721-b549-adcb6ab36766 req-161418d6-0006-42e5-8bda-4262c5bbfb63 service nova] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-edea9f86-2417-4721-b549-adcb6ab36766 req-161418d6-0006-42e5-8bda-4262c5bbfb63 service nova] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.compute.manager [req-edea9f86-2417-4721-b549-adcb6ab36766 req-161418d6-0006-42e5-8bda-4262c5bbfb63 service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] No waiting events found dispatching network-vif-plugged-0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:02:52 user nova-compute[72990]: WARNING nova.compute.manager [req-edea9f86-2417-4721-b549-adcb6ab36766 req-161418d6-0006-42e5-8bda-4262c5bbfb63 service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Received unexpected event network-vif-plugged-0364cc8c-227a-4464-8c2b-9a04f24c568f for instance with vm_state building and task_state spawning.
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108972.558433, f8dca40d-3064-41ae-9374-6aefe9f2b941 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:02:52 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] VM Resumed (Lifecycle Event)
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:02:52 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Instance spawned successfully.
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:02:52 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693108972.565581, f8dca40d-3064-41ae-9374-6aefe9f2b941 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:02:52 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] VM Started (Lifecycle Event)
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:02:52 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:02:52 user nova-compute[72990]: INFO nova.compute.manager [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 27 04:02:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:02:52 user nova-compute[72990]: INFO nova.compute.manager [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Took 30.19 seconds to build instance.
Aug 27 04:02:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9270593c-136a-44b3-bcda-7846272e98a1 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.326s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:02:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:02:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Acquiring lock "fa2cafdb-77ef-4d45-8523-c29c2a258475" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Acquiring lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:05 user nova-compute[72990]: INFO nova.compute.manager [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Terminating instance
Aug 27 04:03:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:03:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG nova.compute.manager [req-97da3573-d738-4cc0-87c4-f1dff622202a req-58735e12-9d6b-4e06-93d4-eb776e14632b service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Received event network-vif-unplugged-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-97da3573-d738-4cc0-87c4-f1dff622202a req-58735e12-9d6b-4e06-93d4-eb776e14632b service nova] Acquiring lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-97da3573-d738-4cc0-87c4-f1dff622202a req-58735e12-9d6b-4e06-93d4-eb776e14632b service nova] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-97da3573-d738-4cc0-87c4-f1dff622202a req-58735e12-9d6b-4e06-93d4-eb776e14632b service nova] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG nova.compute.manager [req-97da3573-d738-4cc0-87c4-f1dff622202a req-58735e12-9d6b-4e06-93d4-eb776e14632b service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] No waiting events found dispatching network-vif-unplugged-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG nova.compute.manager [req-97da3573-d738-4cc0-87c4-f1dff622202a req-58735e12-9d6b-4e06-93d4-eb776e14632b service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Received event network-vif-unplugged-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:03:06 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Instance destroyed successfully.
Aug 27 04:03:06 user nova-compute[72990]: DEBUG nova.objects.instance [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lazy-loading 'resources' on Instance uuid fa2cafdb-77ef-4d45-8523-c29c2a258475 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-217934922',display_name='tempest-VolumesNegativeTest-instance-217934922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-217934922',id=35,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:01:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d930e204d44f738a0817dd476900dc',ramdisk_id='',reservation_id='r-ezw085ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1975228831',owner_user_name='tempest-VolumesNegativeTest-1975228831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:01:22Z,user_data=None,user_id='eaef551320464a43a6c372b055b8b32b',uuid=fa2cafdb-77ef-4d45-8523-c29c2a258475,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "address": "fa:16:3e:3c:d6:a7", "network": {"id": "858361c3-ce2f-4005-80e2-73c398e1d484", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1261fcea31c84dcc85c1c48bca6d4fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b8f19-8a", "ovs_interfaceid": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Converting VIF {"id": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "address": "fa:16:3e:3c:d6:a7", "network": {"id": "858361c3-ce2f-4005-80e2-73c398e1d484", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1261fcea31c84dcc85c1c48bca6d4fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b8f19-8a", "ovs_interfaceid": "a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d6:a7,bridge_name='br-int',has_traffic_filtering=True,id=a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498,network=Network(858361c3-ce2f-4005-80e2-73c398e1d484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b8f19-8a') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG os_vif [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d6:a7,bridge_name='br-int',has_traffic_filtering=True,id=a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498,network=Network(858361c3-ce2f-4005-80e2-73c398e1d484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b8f19-8a') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa44b8f19-8a, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:03:06 user nova-compute[72990]: INFO os_vif [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d6:a7,bridge_name='br-int',has_traffic_filtering=True,id=a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498,network=Network(858361c3-ce2f-4005-80e2-73c398e1d484),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b8f19-8a')
Aug 27 04:03:06 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Deleting instance files /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475_del
Aug 27 04:03:06 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Deletion of /opt/stack/data/nova/instances/fa2cafdb-77ef-4d45-8523-c29c2a258475_del complete
Aug 27 04:03:06 user nova-compute[72990]: INFO nova.compute.manager [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 27 04:03:06 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:03:06 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:03:07 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:03:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-b5378b8f-cb50-4277-b936-79b75956787e req-ba63d7ca-f97e-4631-a8ae-4ee3c3ac6dec service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Received event network-vif-deleted-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:03:07 user nova-compute[72990]: INFO nova.compute.manager [req-b5378b8f-cb50-4277-b936-79b75956787e req-ba63d7ca-f97e-4631-a8ae-4ee3c3ac6dec service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Neutron deleted interface a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498; detaching it from the instance and deleting it from the info cache
Aug 27 04:03:07 user nova-compute[72990]: DEBUG nova.network.neutron [req-b5378b8f-cb50-4277-b936-79b75956787e req-ba63d7ca-f97e-4631-a8ae-4ee3c3ac6dec service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:03:07 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Took 0.76 seconds to deallocate network for instance.
Aug 27 04:03:07 user nova-compute[72990]: DEBUG nova.compute.manager [req-b5378b8f-cb50-4277-b936-79b75956787e req-ba63d7ca-f97e-4631-a8ae-4ee3c3ac6dec service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Detach interface failed, port_id=a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498, reason: Instance fa2cafdb-77ef-4d45-8523-c29c2a258475 could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 04:03:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:07 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:03:07 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:03:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:07 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Deleted allocations for instance fa2cafdb-77ef-4d45-8523-c29c2a258475
Aug 27 04:03:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ca50eaf6-1410-4790-8875-7dc672dbeaaf tempest-VolumesNegativeTest-1975228831 tempest-VolumesNegativeTest-1975228831-project-member] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.433s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-06776da8-03dd-41df-8d65-6c66b11cc452 req-89cc8c24-455a-4209-be70-0f6718dfc5fc service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Received event network-vif-plugged-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:03:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-06776da8-03dd-41df-8d65-6c66b11cc452 req-89cc8c24-455a-4209-be70-0f6718dfc5fc service nova] Acquiring lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-06776da8-03dd-41df-8d65-6c66b11cc452 req-89cc8c24-455a-4209-be70-0f6718dfc5fc service nova] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-06776da8-03dd-41df-8d65-6c66b11cc452 req-89cc8c24-455a-4209-be70-0f6718dfc5fc service nova] Lock "fa2cafdb-77ef-4d45-8523-c29c2a258475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-06776da8-03dd-41df-8d65-6c66b11cc452 req-89cc8c24-455a-4209-be70-0f6718dfc5fc service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] No waiting events found dispatching network-vif-plugged-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:03:08 user nova-compute[72990]: WARNING nova.compute.manager [req-06776da8-03dd-41df-8d65-6c66b11cc452 req-89cc8c24-455a-4209-be70-0f6718dfc5fc service nova] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Received unexpected event network-vif-plugged-a44b8f19-8ac1-4cd0-b4c3-ad39fb2ce498 for instance with vm_state deleted and task_state None.
Aug 27 04:03:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:03:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:20 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:03:20 user nova-compute[72990]: INFO nova.compute.claims [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Claim successful on node user
Aug 27 04:03:20 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:03:20 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:03:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG nova.network.neutron [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:03:21 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:03:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG nova.policy [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed6cd92bb0204e2f9afb35f8d9d2243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34fab9761d749e09b47e567fa51a7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:03:21 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Creating image(s)
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "/opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "/opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "/opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693108986.6864142, fa2cafdb-77ef-4d45-8523-c29c2a258475 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:03:21 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] VM Stopped (Lifecycle Event)
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk 1073741824" returned: 0 in 0.053s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-6c5fef28-ee4e-4fc7-b2cd-fa4a8c9c2a3b None None] [instance: fa2cafdb-77ef-4d45-8523-c29c2a258475] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG nova.network.neutron [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Successfully created port: 449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:03:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Cannot resize image /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Ensure instance console log exists: /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Successfully updated port: 449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquired lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG nova.compute.manager [req-3c9ca368-1085-4554-b808-0587d21ba26f req-f5445807-11b0-4fda-bc93-9107ae5e1141 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Received event network-changed-449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG nova.compute.manager [req-3c9ca368-1085-4554-b808-0587d21ba26f req-f5445807-11b0-4fda-bc93-9107ae5e1141 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Refreshing instance network info cache due to event network-changed-449158a8-0249-4545-98c9-ecfccbcc1148. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3c9ca368-1085-4554-b808-0587d21ba26f req-f5445807-11b0-4fda-bc93-9107ae5e1141 service nova] Acquiring lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:03:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updating instance_info_cache with network_info: [{"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Releasing lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Instance network_info: |[{"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3c9ca368-1085-4554-b808-0587d21ba26f req-f5445807-11b0-4fda-bc93-9107ae5e1141 service nova] Acquired lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.network.neutron [req-3c9ca368-1085-4554-b808-0587d21ba26f req-f5445807-11b0-4fda-bc93-9107ae5e1141 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Refreshing network info cache for port 449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Start _get_guest_xml network_info=[{"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:03:23 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:03:23 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:03:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2126323888',display_name='tempest-TestStampPattern-server-2126323888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2126323888',id=39,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLnR311AGfUBQnoCXVcWBj+0ahQsHJMZMsICHM9pMdM0SqwxaZxX2k42Vtz1wur5D7C2c2Z+aWIY4GEPKcd/XyikzDfg8PQJ3qOnMiQdQiAFgolbW2xxY+fNS+9ERDXhw==',key_name='tempest-TestStampPattern-1905683854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e34fab9761d749e09b47e567fa51a7fb',ramdisk_id='',reservation_id='r-lz0wn5m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1496658836',owner_user_name='tempest-TestStampPattern-1496658836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:03:21Z,user_data=None,user_id='ed6cd92bb0204e2f9afb35f8d9d2243b',uuid=da3f86d1-09e4-4c85-b275-145c86f1aa15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Converting VIF {"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:c0:a1,bridge_name='br-int',has_traffic_filtering=True,id=449158a8-0249-4545-98c9-ecfccbcc1148,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449158a8-02') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lazy-loading 'pci_devices' on Instance uuid da3f86d1-09e4-4c85-b275-145c86f1aa15 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:03:23 user nova-compute[72990]:   <uuid>da3f86d1-09e4-4c85-b275-145c86f1aa15</uuid>
Aug 27 04:03:23 user nova-compute[72990]:   <name>instance-00000027</name>
Aug 27 04:03:23 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:03:23 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:03:23 user nova-compute[72990]:   <metadata>
Aug 27 04:03:23 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:03:23 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:03:23 user nova-compute[72990]:       <nova:name>tempest-TestStampPattern-server-2126323888</nova:name>
Aug 27 04:03:23 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:03:23</nova:creationTime>
Aug 27 04:03:23 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:03:23 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:03:23 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:03:23 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:03:23 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:03:23 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:03:23 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:03:23 user nova-compute[72990]:       <nova:owner>
Aug 27 04:03:23 user nova-compute[72990]:         <nova:user uuid="ed6cd92bb0204e2f9afb35f8d9d2243b">tempest-TestStampPattern-1496658836-project-member</nova:user>
Aug 27 04:03:23 user nova-compute[72990]:         <nova:project uuid="e34fab9761d749e09b47e567fa51a7fb">tempest-TestStampPattern-1496658836</nova:project>
Aug 27 04:03:23 user nova-compute[72990]:       </nova:owner>
Aug 27 04:03:23 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 04:03:23 user nova-compute[72990]:       <nova:ports>
Aug 27 04:03:23 user nova-compute[72990]:         <nova:port uuid="449158a8-0249-4545-98c9-ecfccbcc1148">
Aug 27 04:03:23 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 04:03:23 user nova-compute[72990]:         </nova:port>
Aug 27 04:03:23 user nova-compute[72990]:       </nova:ports>
Aug 27 04:03:23 user nova-compute[72990]:     </nova:instance>
Aug 27 04:03:23 user nova-compute[72990]:   </metadata>
Aug 27 04:03:23 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:03:23 user nova-compute[72990]:     <system>
Aug 27 04:03:23 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:03:23 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:03:23 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:03:23 user nova-compute[72990]:       <entry name="serial">da3f86d1-09e4-4c85-b275-145c86f1aa15</entry>
Aug 27 04:03:23 user nova-compute[72990]:       <entry name="uuid">da3f86d1-09e4-4c85-b275-145c86f1aa15</entry>
Aug 27 04:03:23 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:03:23 user nova-compute[72990]:     </system>
Aug 27 04:03:23 user nova-compute[72990]:   </sysinfo>
Aug 27 04:03:23 user nova-compute[72990]:   <os>
Aug 27 04:03:23 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:03:23 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:03:23 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:03:23 user nova-compute[72990]:   </os>
Aug 27 04:03:23 user nova-compute[72990]:   <features>
Aug 27 04:03:23 user nova-compute[72990]:     <acpi/>
Aug 27 04:03:23 user nova-compute[72990]:     <apic/>
Aug 27 04:03:23 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:03:23 user nova-compute[72990]:   </features>
Aug 27 04:03:23 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:03:23 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:03:23 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:03:23 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:03:23 user nova-compute[72990]:   </clock>
Aug 27 04:03:23 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:03:23 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:03:23 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:03:23 user nova-compute[72990]:   </cpu>
Aug 27 04:03:23 user nova-compute[72990]:   <devices>
Aug 27 04:03:23 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:03:23 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:03:23 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk"/>
Aug 27 04:03:23 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:03:23 user nova-compute[72990]:     </disk>
Aug 27 04:03:23 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:03:23 user nova-compute[72990]:       <mac address="fa:16:3e:6d:c0:a1"/>
Aug 27 04:03:23 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:03:23 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:03:23 user nova-compute[72990]:       <target dev="tap449158a8-02"/>
Aug 27 04:03:23 user nova-compute[72990]:     </interface>
Aug 27 04:03:23 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:03:23 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/console.log" append="off"/>
Aug 27 04:03:23 user nova-compute[72990]:     </serial>
Aug 27 04:03:23 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:03:23 user nova-compute[72990]:     <video>
Aug 27 04:03:23 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:03:23 user nova-compute[72990]:     </video>
Aug 27 04:03:23 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:03:23 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:03:23 user nova-compute[72990]:     </rng>
Aug 27 04:03:23 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:03:23 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:03:23 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:03:23 user nova-compute[72990]:     </memballoon>
Aug 27 04:03:23 user nova-compute[72990]:   </devices>
Aug 27 04:03:23 user nova-compute[72990]: </domain>
Aug 27 04:03:23 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:03:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2126323888',display_name='tempest-TestStampPattern-server-2126323888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2126323888',id=39,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLnR311AGfUBQnoCXVcWBj+0ahQsHJMZMsICHM9pMdM0SqwxaZxX2k42Vtz1wur5D7C2c2Z+aWIY4GEPKcd/XyikzDfg8PQJ3qOnMiQdQiAFgolbW2xxY+fNS+9ERDXhw==',key_name='tempest-TestStampPattern-1905683854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e34fab9761d749e09b47e567fa51a7fb',ramdisk_id='',reservation_id='r-lz0wn5m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1496658836',owner_user_name='tempest-TestStampPattern-1496658836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:03:21Z,user_data=None,user_id='ed6cd92bb0204e2f9afb35f8d9d2243b',uuid=da3f86d1-09e4-4c85-b275-145c86f1aa15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Converting VIF {"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:c0:a1,bridge_name='br-int',has_traffic_filtering=True,id=449158a8-0249-4545-98c9-ecfccbcc1148,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449158a8-02') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG os_vif [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:c0:a1,bridge_name='br-int',has_traffic_filtering=True,id=449158a8-0249-4545-98c9-ecfccbcc1148,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449158a8-02') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap449158a8-02, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap449158a8-02, col_values=(('external_ids', {'iface-id': '449158a8-0249-4545-98c9-ecfccbcc1148', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:c0:a1', 'vm-uuid': 'da3f86d1-09e4-4c85-b275-145c86f1aa15'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:23 user nova-compute[72990]: INFO os_vif [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:c0:a1,bridge_name='br-int',has_traffic_filtering=True,id=449158a8-0249-4545-98c9-ecfccbcc1148,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449158a8-02')
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-f9bf9d4f-b5df-426e-805e-b103081c2086 req-beb9061b-cc79-4641-be46-0c80c6ecaa64 service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Received event network-changed-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-f9bf9d4f-b5df-426e-805e-b103081c2086 req-beb9061b-cc79-4641-be46-0c80c6ecaa64 service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Refreshing instance network info cache due to event network-changed-9198f9ec-e89a-4cde-81fe-e8156d77c6b8. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f9bf9d4f-b5df-426e-805e-b103081c2086 req-beb9061b-cc79-4641-be46-0c80c6ecaa64 service nova] Acquiring lock "refresh_cache-eeaea5e8-16c9-4a0d-b296-e883311331ac" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f9bf9d4f-b5df-426e-805e-b103081c2086 req-beb9061b-cc79-4641-be46-0c80c6ecaa64 service nova] Acquired lock "refresh_cache-eeaea5e8-16c9-4a0d-b296-e883311331ac" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.network.neutron [req-f9bf9d4f-b5df-426e-805e-b103081c2086 req-beb9061b-cc79-4641-be46-0c80c6ecaa64 service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Refreshing network info cache for port 9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:03:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] No VIF found with MAC fa:16:3e:6d:c0:a1, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:03:24 user nova-compute[72990]: DEBUG nova.network.neutron [req-3c9ca368-1085-4554-b808-0587d21ba26f req-f5445807-11b0-4fda-bc93-9107ae5e1141 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updated VIF entry in instance network info cache for port 449158a8-0249-4545-98c9-ecfccbcc1148. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:03:24 user nova-compute[72990]: DEBUG nova.network.neutron [req-3c9ca368-1085-4554-b808-0587d21ba26f req-f5445807-11b0-4fda-bc93-9107ae5e1141 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updating instance_info_cache with network_info: [{"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:03:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3c9ca368-1085-4554-b808-0587d21ba26f req-f5445807-11b0-4fda-bc93-9107ae5e1141 service nova] Releasing lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:03:24 user nova-compute[72990]: DEBUG nova.network.neutron [req-f9bf9d4f-b5df-426e-805e-b103081c2086 req-beb9061b-cc79-4641-be46-0c80c6ecaa64 service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Updated VIF entry in instance network info cache for port 9198f9ec-e89a-4cde-81fe-e8156d77c6b8. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:03:24 user nova-compute[72990]: DEBUG nova.network.neutron [req-f9bf9d4f-b5df-426e-805e-b103081c2086 req-beb9061b-cc79-4641-be46-0c80c6ecaa64 service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Updating instance_info_cache with network_info: [{"id": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "address": "fa:16:3e:07:44:36", "network": {"id": "f6683e38-2ada-42b7-bf0b-5437286bb052", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1399247984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "591e030390fe4f76803a298194788068", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9198f9ec-e8", "ovs_interfaceid": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:03:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f9bf9d4f-b5df-426e-805e-b103081c2086 req-beb9061b-cc79-4641-be46-0c80c6ecaa64 service nova] Releasing lock "refresh_cache-eeaea5e8-16c9-4a0d-b296-e883311331ac" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:03:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-0404ee2b-b922-4a40-ae45-20b2a936a756 req-b0c8cfd3-cbf9-4ef4-8d87-204caee75c6d service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Received event network-vif-plugged-449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:03:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0404ee2b-b922-4a40-ae45-20b2a936a756 req-b0c8cfd3-cbf9-4ef4-8d87-204caee75c6d service nova] Acquiring lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0404ee2b-b922-4a40-ae45-20b2a936a756 req-b0c8cfd3-cbf9-4ef4-8d87-204caee75c6d service nova] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0404ee2b-b922-4a40-ae45-20b2a936a756 req-b0c8cfd3-cbf9-4ef4-8d87-204caee75c6d service nova] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-0404ee2b-b922-4a40-ae45-20b2a936a756 req-b0c8cfd3-cbf9-4ef4-8d87-204caee75c6d service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] No waiting events found dispatching network-vif-plugged-449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:03:25 user nova-compute[72990]: WARNING nova.compute.manager [req-0404ee2b-b922-4a40-ae45-20b2a936a756 req-b0c8cfd3-cbf9-4ef4-8d87-204caee75c6d service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Received unexpected event network-vif-plugged-449158a8-0249-4545-98c9-ecfccbcc1148 for instance with vm_state building and task_state spawning.
Aug 27 04:03:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109006.9103909, da3f86d1-09e4-4c85-b275-145c86f1aa15 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:03:26 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] VM Resumed (Lifecycle Event)
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:03:26 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Instance spawned successfully.
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:03:26 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:03:26 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109006.9118693, da3f86d1-09e4-4c85-b275-145c86f1aa15 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:03:26 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] VM Started (Lifecycle Event)
Aug 27 04:03:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:03:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:03:27 user nova-compute[72990]: INFO nova.compute.manager [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Took 5.74 seconds to spawn the instance on the hypervisor.
Aug 27 04:03:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:03:27 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:03:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-10ec62c0-6415-47d7-8325-e70b9482f188 req-1766074c-3619-4f43-941e-ba96883d593c service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Received event network-vif-plugged-449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:03:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-10ec62c0-6415-47d7-8325-e70b9482f188 req-1766074c-3619-4f43-941e-ba96883d593c service nova] Acquiring lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-10ec62c0-6415-47d7-8325-e70b9482f188 req-1766074c-3619-4f43-941e-ba96883d593c service nova] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-10ec62c0-6415-47d7-8325-e70b9482f188 req-1766074c-3619-4f43-941e-ba96883d593c service nova] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-10ec62c0-6415-47d7-8325-e70b9482f188 req-1766074c-3619-4f43-941e-ba96883d593c service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] No waiting events found dispatching network-vif-plugged-449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:03:27 user nova-compute[72990]: WARNING nova.compute.manager [req-10ec62c0-6415-47d7-8325-e70b9482f188 req-1766074c-3619-4f43-941e-ba96883d593c service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Received unexpected event network-vif-plugged-449158a8-0249-4545-98c9-ecfccbcc1148 for instance with vm_state active and task_state None.
Aug 27 04:03:27 user nova-compute[72990]: INFO nova.compute.manager [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Took 6.57 seconds to build instance.
Aug 27 04:03:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c7e472d0-2a49-49c1-a08a-1c1cd2c7e3fe tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.672s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG nova.objects.instance [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lazy-loading 'flavor' on Instance uuid eeaea5e8-16c9-4a0d-b296-e883311331ac {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:28 user nova-compute[72990]: INFO nova.compute.manager [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Attaching volume 7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a to /dev/vdb
Aug 27 04:03:28 user nova-compute[72990]: DEBUG os_brick.utils [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[65439562-d101-4fc0-9d34-8213db854377]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20f5186-ae01-46df-98a0-e25142cedf60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da7aeed-29a2-4823-953a-fa577283ccd0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8174d3-0a93-48c8-a73c-230021de508b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:03:28 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:03:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b824b0a-893c-42b1-9069-223b3dbfc080]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG os_brick.utils [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:03:28 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Updating existing volume attachment record: 874ae458-26c7-4d53-8e23-85d44fc23c42 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:03:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:36 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:03:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "7835f781-b543-4370-922b-3d2a76f9821b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:37 user nova-compute[72990]: INFO nova.compute.manager [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Terminating instance
Aug 27 04:03:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:03:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG nova.compute.manager [req-6929ade6-19a0-43e8-9694-bddf7c9e8e26 req-8d9cb2cc-2428-4d81-ba6a-779730e5417f service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-unplugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6929ade6-19a0-43e8-9694-bddf7c9e8e26 req-8d9cb2cc-2428-4d81-ba6a-779730e5417f service nova] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6929ade6-19a0-43e8-9694-bddf7c9e8e26 req-8d9cb2cc-2428-4d81-ba6a-779730e5417f service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6929ade6-19a0-43e8-9694-bddf7c9e8e26 req-8d9cb2cc-2428-4d81-ba6a-779730e5417f service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG nova.compute.manager [req-6929ade6-19a0-43e8-9694-bddf7c9e8e26 req-8d9cb2cc-2428-4d81-ba6a-779730e5417f service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] No waiting events found dispatching network-vif-unplugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG nova.compute.manager [req-6929ade6-19a0-43e8-9694-bddf7c9e8e26 req-8d9cb2cc-2428-4d81-ba6a-779730e5417f service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-unplugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Instance destroyed successfully.
Aug 27 04:03:38 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lazy-loading 'resources' on Instance uuid 7835f781-b543-4370-922b-3d2a76f9821b {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1426790154',display_name='tempest-ServerStableDeviceRescueTest-server-1426790154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1426790154',id=4,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuie8I1zmPTJR4MWFJd4uL9H7Y7zaw0i0/HxDbhxujiX8dZTY7PejDyY5i59a4QWzNZOOaKk6B+aPRfLvRmlc5NyO+hiXVGcLw0acVKee1aqH5Y4VgHEQo51OQ+4w65xg==',key_name='tempest-keypair-1407954263',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:44:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37efbadb079847d6852574734e40de9a',ramdisk_id='',reservation_id='r-q7dxzftt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-181138782',owner_user_name='tempest-ServerStableDeviceRescueTest-181138782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:46:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5856ab8a362e440abcb62fdbc61f495b',uuid=7835f781-b543-4370-922b-3d2a76f9821b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Converting VIF {"id": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "address": "fa:16:3e:1c:62:6e", "network": {"id": "58588dcd-f0f9-4efd-91b7-a15aeec22905", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-851265449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37efbadb079847d6852574734e40de9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb08b4e3-74", "ovs_interfaceid": "eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:62:6e,bridge_name='br-int',has_traffic_filtering=True,id=eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d,network=Network(58588dcd-f0f9-4efd-91b7-a15aeec22905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb08b4e3-74') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_vif [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:62:6e,bridge_name='br-int',has_traffic_filtering=True,id=eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d,network=Network(58588dcd-f0f9-4efd-91b7-a15aeec22905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb08b4e3-74') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb08b4e3-74, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:38 user nova-compute[72990]: INFO os_vif [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:62:6e,bridge_name='br-int',has_traffic_filtering=True,id=eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d,network=Network(58588dcd-f0f9-4efd-91b7-a15aeec22905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb08b4e3-74')
Aug 27 04:03:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAaSEuhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:03:38 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[998f0177-4f35-4051-b617-1b030d5422b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea05e58-3fc9-4d84-84c1-0b742267ab7f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:03:38 user nova-compute[72990]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:03:38 user nova-compute[72990]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)
Aug 27 04:03:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab (non-flash)
Aug 27 04:03:38 user nova-compute[72990]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:03:38 user nova-compute[72990]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)
Aug 27 04:03:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f43d0f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab'): ({'sdg'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Removing single pathed devices sdg {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[376eca0c-4629-4840-bcd6-32acac837ae3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad3af9f-963a-4210-810a-a61b0e1388ae]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Flushing IO for device /dev/sdg {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6963773d-31f6-4faf-86d1-5b3be14fd14c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eae3ce-6d95-4267-a196-3987e035791b]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] SCSI volumes sdg have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[34018926-98b8-45af-afb0-dda5c0c5aafb]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d573b7-a899-4e67-add5-608b02e0e33e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab, portal: 172.16.0.220,3260]
Aug 27 04:03:38 user nova-compute[72990]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab, portal: 172.16.0.220,3260] successful.
Aug 27 04:03:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc5c32f-6b98-4193-800d-09f5c79731ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[547c9fd8-f988-4ed3-9d77-b2404b2ecc95]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] <== disconnect_volume: return (312ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:03:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Deleting instance files /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b_del
Aug 27 04:03:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Deletion of /opt/stack/data/nova/instances/7835f781-b543-4370-922b-3d2a76f9821b_del complete
Aug 27 04:03:38 user nova-compute[72990]: INFO nova.compute.manager [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 27 04:03:38 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:03:38 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:03:39 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:03:39 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Took 0.97 seconds to deallocate network for instance.
Aug 27 04:03:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-31930286-4f8f-4be8-aa38-da465211e9cd req-a24fb815-b835-4996-a178-25d1bde65487 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-deleted-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:03:39 user nova-compute[72990]: INFO nova.compute.manager [req-31930286-4f8f-4be8-aa38-da465211e9cd req-a24fb815-b835-4996-a178-25d1bde65487 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Neutron deleted interface eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d; detaching it from the instance and deleting it from the info cache
Aug 27 04:03:39 user nova-compute[72990]: DEBUG nova.network.neutron [req-31930286-4f8f-4be8-aa38-da465211e9cd req-a24fb815-b835-4996-a178-25d1bde65487 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:03:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-31930286-4f8f-4be8-aa38-da465211e9cd req-a24fb815-b835-4996-a178-25d1bde65487 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Detach interface failed, port_id=eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d, reason: Instance 7835f781-b543-4370-922b-3d2a76f9821b could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-aae45332-f73b-46d8-b8f7-be79649d7bd1 req-8f811d07-9a8d-45ef-acca-8a1a9b091b06 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aae45332-f73b-46d8-b8f7-be79649d7bd1 req-8f811d07-9a8d-45ef-acca-8a1a9b091b06 service nova] Acquiring lock "7835f781-b543-4370-922b-3d2a76f9821b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aae45332-f73b-46d8-b8f7-be79649d7bd1 req-8f811d07-9a8d-45ef-acca-8a1a9b091b06 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aae45332-f73b-46d8-b8f7-be79649d7bd1 req-8f811d07-9a8d-45ef-acca-8a1a9b091b06 service nova] Lock "7835f781-b543-4370-922b-3d2a76f9821b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-aae45332-f73b-46d8-b8f7-be79649d7bd1 req-8f811d07-9a8d-45ef-acca-8a1a9b091b06 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] No waiting events found dispatching network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:03:40 user nova-compute[72990]: WARNING nova.compute.manager [req-aae45332-f73b-46d8-b8f7-be79649d7bd1 req-8f811d07-9a8d-45ef-acca-8a1a9b091b06 service nova] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Received unexpected event network-vif-plugged-eb08b4e3-74fc-45be-83f1-e8d9f1c6c00d for instance with vm_state active and task_state deleting.
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:03:40 user nova-compute[72990]: INFO nova.compute.manager [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Took 0.82 seconds to detach 1 volumes for instance.
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJgxikNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:03:40 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:03:40 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:03:40 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f27aa39-98d1-4a7f-a341-996bb5ac9978]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:03:40 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6d0e6a-e684-4026-a911-7f2de8459865]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a] added
Aug 27 04:03:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ee7334-7b69-406c-b685-52e04738298f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[edef7e05-b9d3-43cf-9513-767504e5182e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJgxikNH {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJgxikNH" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[980b24ed-ed6a-4072-a86c-362ad6b27035]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bJgxikNH'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96a2dfd-54f8-4dd6-aa9c-e5a0d57f5504]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef939e2-9346-4375-978c-8a942875f240]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:03:40 user nova-compute[72990]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)
Aug 27 04:03:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:03:40 user nova-compute[72990]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)
Aug 27 04:03:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:03:40 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b88d7e-3449-4bfa-aa0a-0a39a7c26aaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a, portal: 172.16.0.220,3260]
Aug 27 04:03:41 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a, portal: 172.16.0.220,3260] successful.
Aug 27 04:03:41 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f28470-abd8-445e-a917-c49628c0aa72]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:41 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Deleted allocations for instance 7835f781-b543-4370-922b-3d2a76f9821b
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9212b7f-5e3c-471f-ae68-216ff86a820b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:03:41 user nova-compute[72990]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)
Aug 27 04:03:41 user nova-compute[72990]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a (non-flash)
Aug 27 04:03:41 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:03:41 user nova-compute[72990]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)
Aug 27 04:03:41 user nova-compute[72990]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a (non-flash)
Aug 27 04:03:41 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b56723c-37ac-4dad-88ba-06d9160e33d5]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJgxikNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:03:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f5c2a7a0-0a40-4c99-b2e9-67241beb8c5b tempest-ServerStableDeviceRescueTest-181138782 tempest-ServerStableDeviceRescueTest-181138782-project-member] Lock "7835f781-b543-4370-922b-3d2a76f9821b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.448s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23834306636663036', 'path': '/dev/sdd'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834306636663036', 'path': '/dev/sdd'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG nova.objects.instance [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lazy-loading 'flavor' on Instance uuid eeaea5e8-16c9-4a0d-b296-e883311331ac {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:03:42 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:03:42 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 04:03:42 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:03:42 user nova-compute[72990]:   <serial>7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a</serial>
Aug 27 04:03:42 user nova-compute[72990]: </disk>
Aug 27 04:03:42 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] No VIF found with MAC fa:16:3e:07:44:36, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-279686ed-cb53-468c-aaef-239a13b93203 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.856s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:03:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:43 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:44 user nova-compute[72990]: INFO nova.compute.manager [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Detaching volume 7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a
Aug 27 04:03:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:03:44 user nova-compute[72990]: INFO nova.virt.block_device [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Attempting to driver detach volume 7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a from mountpoint /dev/vdb
Aug 27 04:03:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Attempting to detach device vdb from instance eeaea5e8-16c9-4a0d-b296-e883311331ac from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:03:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:03:44 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:03:44 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 04:03:44 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:03:44 user nova-compute[72990]:   <serial>7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a</serial>
Aug 27 04:03:44 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:03:44 user nova-compute[72990]: </disk>
Aug 27 04:03:44 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:03:44 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Successfully detached device vdb from instance eeaea5e8-16c9-4a0d-b296-e883311331ac from the persistent domain config.
Aug 27 04:03:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eeaea5e8-16c9-4a0d-b296-e883311331ac from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:03:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:03:44 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:03:44 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 04:03:44 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:03:44 user nova-compute[72990]:   <serial>7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a</serial>
Aug 27 04:03:44 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:03:44 user nova-compute[72990]: </disk>
Aug 27 04:03:44 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693109025.2359805, eeaea5e8-16c9-4a0d-b296-e883311331ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eeaea5e8-16c9-4a0d-b296-e883311331ac {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:03:45 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Successfully detached device vdb from instance eeaea5e8-16c9-4a0d-b296-e883311331ac from the live domain config.
Aug 27 04:03:45 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:03:45 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7807MB free_disk=25.15427017211914GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJgxikNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:03:45 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3887fe-74f6-4922-bae9-e13763ee8ce3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a3b7d3-4bf0-44cc-a717-760f2ec65266]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:03:45 user nova-compute[72990]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)
Aug 27 04:03:45 user nova-compute[72990]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a (non-flash)
Aug 27 04:03:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:03:45 user nova-compute[72990]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)
Aug 27 04:03:45 user nova-compute[72990]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a (non-flash)
Aug 27 04:03:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44dda20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a'): ({'sdd'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Removing single pathed devices sdd {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance eeaea5e8-16c9-4a0d-b296-e883311331ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ae9e24d9-20e5-4642-b6d3-de298c138730 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance f8dca40d-3064-41ae-9374-6aefe9f2b941 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance da3f86d1-09e4-4c85-b275-145c86f1aa15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb567fde-2b47-46ce-87cc-860cb06cd033]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a4b9a5-fd38-4cd0-8219-49d664a32cb9]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Flushing IO for device /dev/sdd {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[88597083-5ece-4a2d-914f-3b24cf5f07c2]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbdd3cf-0471-46b8-a292-1267c36cf33b]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[462acdeb-496b-46eb-9057-1dea82fa0013]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f39cb3-81e2-4fed-8e9c-6e9cd30c7f5b]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a, portal: 172.16.0.220,3260]
Aug 27 04:03:45 user nova-compute[72990]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a, portal: 172.16.0.220,3260] successful.
Aug 27 04:03:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7812854a-d2ff-4a34-b77b-9c6cfd6a0a4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5cf54d-2398-4e39-a62d-c0c790808a65]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] <== disconnect_volume: return (326ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:03:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:46 user nova-compute[72990]: DEBUG nova.objects.instance [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lazy-loading 'flavor' on Instance uuid eeaea5e8-16c9-4a0d-b296-e883311331ac {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:03:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-899dadf2-d591-4692-8528-3d0458089cd4 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.932s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:03:46 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:03:46 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:03:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:03:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:03:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:03:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:03:46 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:03:46 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:03:47 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updating instance_info_cache with network_info: [{"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:03:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:03:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:03:47 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:03:47 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:03:47 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:03:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:53 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109018.466038, 7835f781-b543-4370-922b-3d2a76f9821b => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:03:53 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] VM Stopped (Lifecycle Event)
Aug 27 04:03:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2f674ee6-ec4d-4b34-9a7d-d76ed24ae39e None None] [instance: 7835f781-b543-4370-922b-3d2a76f9821b] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:03:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:03:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "ae9e24d9-20e5-4642-b6d3-de298c138730" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG nova.objects.instance [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lazy-loading 'flavor' on Instance uuid ae9e24d9-20e5-4642-b6d3-de298c138730 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "ae9e24d9-20e5-4642-b6d3-de298c138730" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:01 user nova-compute[72990]: INFO nova.compute.manager [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Attaching volume e51aceac-0cd7-48b0-ac03-80f6fc907229 to /dev/vdb
Aug 27 04:04:01 user nova-compute[72990]: DEBUG os_brick.utils [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7685be-4745-49c9-83d8-6f185e14e9e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f43c68d-f5fa-41ef-bc79-4b32ac5d8fdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f706ef5-ff12-42dd-aa10-e04caa1fbeba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9625a2-5e69-4f28-b2a7-5af404bc13ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:04:01 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:04:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f774f406-6954-4875-b2ef-88d16590d0fa]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG os_brick.utils [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:04:01 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Updating existing volume attachment record: 104636d7-1a8e-4358-a953-4fad41b9f10f {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:04:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "f8dca40d-3064-41ae-9374-6aefe9f2b941" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:13 user nova-compute[72990]: INFO nova.compute.manager [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Terminating instance
Aug 27 04:04:13 user nova-compute[72990]: DEBUG nova.compute.manager [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-51c7229d-1433-4483-aa88-b263854556d9 req-779246e6-583d-4ba6-8669-3f9027665021 service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Received event network-vif-unplugged-0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-51c7229d-1433-4483-aa88-b263854556d9 req-779246e6-583d-4ba6-8669-3f9027665021 service nova] Acquiring lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-51c7229d-1433-4483-aa88-b263854556d9 req-779246e6-583d-4ba6-8669-3f9027665021 service nova] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-51c7229d-1433-4483-aa88-b263854556d9 req-779246e6-583d-4ba6-8669-3f9027665021 service nova] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-51c7229d-1433-4483-aa88-b263854556d9 req-779246e6-583d-4ba6-8669-3f9027665021 service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] No waiting events found dispatching network-vif-unplugged-0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:04:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-51c7229d-1433-4483-aa88-b263854556d9 req-779246e6-583d-4ba6-8669-3f9027665021 service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Received event network-vif-unplugged-0364cc8c-227a-4464-8c2b-9a04f24c568f for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:04:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Instance destroyed successfully.
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.objects.instance [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lazy-loading 'resources' on Instance uuid f8dca40d-3064-41ae-9374-6aefe9f2b941 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1902593521',display_name='tempest-TestVolumeBootPattern-server-1902593521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1902593521',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-ky023p0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:02:53Z,user_data=None,user_id='cf3112e616344af7873a50d134260637',uuid=f8dca40d-3064-41ae-9374-6aefe9f2b941,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "address": "fa:16:3e:b5:9a:06", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0364cc8c-22", "ovs_interfaceid": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "address": "fa:16:3e:b5:9a:06", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0364cc8c-22", "ovs_interfaceid": "0364cc8c-227a-4464-8c2b-9a04f24c568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=0364cc8c-227a-4464-8c2b-9a04f24c568f,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0364cc8c-22') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_vif [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=0364cc8c-227a-4464-8c2b-9a04f24c568f,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0364cc8c-22') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0364cc8c-22, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:14 user nova-compute[72990]: INFO nova.compute.manager [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Detaching volume 2dc92d69-6572-4583-94d4-fb25f5eb3714
Aug 27 04:04:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:04:14 user nova-compute[72990]: INFO os_vif [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9a:06,bridge_name='br-int',has_traffic_filtering=True,id=0364cc8c-227a-4464-8c2b-9a04f24c568f,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0364cc8c-22')
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdSGItVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:04:14 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[45042b0d-7906-4c9f-bbb7-84e17c0002ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: INFO nova.virt.block_device [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Attempting to driver detach volume 2dc92d69-6572-4583-94d4-fb25f5eb3714 from mountpoint /dev/vdb
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2710717-feab-41fd-a962-60eaf95480df]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:04:14 user nova-compute[72990]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)
Aug 27 04:04:14 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:04:14 user nova-compute[72990]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 (non-flash)
Aug 27 04:04:14 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44dc3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Attempting to detach device vdb from instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:04:14 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:04:14 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:04:14 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:04:14 user nova-compute[72990]:   <serial>2dc92d69-6572-4583-94d4-fb25f5eb3714</serial>
Aug 27 04:04:14 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 04:04:14 user nova-compute[72990]: </disk>
Aug 27 04:04:14 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62d9277-cbd8-4e6f-82e9-f4c4c67af362]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully detached device vdb from instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 from the persistent domain config.
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:04:14 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:04:14 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:04:14 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:04:14 user nova-compute[72990]:   <serial>2dc92d69-6572-4583-94d4-fb25f5eb3714</serial>
Aug 27 04:04:14 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 04:04:14 user nova-compute[72990]: </disk>
Aug 27 04:04:14 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[572b9808-9c82-4528-a0b0-7229f3aa03b9]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d97f62-8f59-4994-85ba-cbf3ba6abfd1]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[29148c5c-3e03-47b6-97a0-3472dacc2945]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[521df89c-5ad3-4968-a56e-e667eb2e763b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82a449e-d0ae-49d1-8e6f-1a32e57891c7]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2, portal: 172.16.0.220,3260]
Aug 27 04:04:14 user nova-compute[72990]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2, portal: 172.16.0.220,3260] successful.
Aug 27 04:04:14 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18a604c-93f6-4cc7-8f7a-eb0bd39fc570]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== disconnect_volume: return (308ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:04:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Deleting instance files /opt/stack/data/nova/instances/f8dca40d-3064-41ae-9374-6aefe9f2b941_del
Aug 27 04:04:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Deletion of /opt/stack/data/nova/instances/f8dca40d-3064-41ae-9374-6aefe9f2b941_del complete
Aug 27 04:04:14 user nova-compute[72990]: INFO nova.compute.manager [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693109054.6674085, aef3be9a-fd69-4428-97c3-1016d97ca0e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:04:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully detached device vdb from instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 from the live domain config.
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAMHsEcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:04:14 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7e73f1-4b68-4282-a82a-26474e085137]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfbcf24-013f-4efe-9b46-a83915436576]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:04:14 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 (non-flash)
Aug 27 04:04:14 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44dd990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af0cac7-e004-4019-8b0d-0b81ef251282]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aa16fc-c8d9-4d86-86ae-f16826eaf2dc]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d073b3-4fc9-44c5-9e72-f27ca0ce0bd3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[390df097-ef67-46a5-b7dc-8129fb016773]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c872bcb5-24a3-4a78-9032-33c014f6384c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66cd1e5-0761-4db3-aa6b-df75d0146930]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260]
Aug 27 04:04:14 user nova-compute[72990]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714, portal: 172.16.0.220,3260] successful.
Aug 27 04:04:14 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc92d69-6572-4583-94d4-fb25f5eb3714 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3f4977-ce5a-4baf-b294-ea96168789dd]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] <== disconnect_volume: return (301ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:04:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:04:15 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:04:15 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Took 0.55 seconds to deallocate network for instance.
Aug 27 04:04:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-914f69de-c136-4291-a953-fd8493d71b56 req-ad628c93-739d-4fa0-ac76-3b95ac57c8a3 service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Received event network-vif-deleted-0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:04:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-16f866eb-c683-4fe0-9047-45c3e9a8f893 req-25a2bc4a-dc9e-49d9-b7c5-cd5d604d5e0d service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Received event network-vif-plugged-0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:04:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-16f866eb-c683-4fe0-9047-45c3e9a8f893 req-25a2bc4a-dc9e-49d9-b7c5-cd5d604d5e0d service nova] Acquiring lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-16f866eb-c683-4fe0-9047-45c3e9a8f893 req-25a2bc4a-dc9e-49d9-b7c5-cd5d604d5e0d service nova] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-16f866eb-c683-4fe0-9047-45c3e9a8f893 req-25a2bc4a-dc9e-49d9-b7c5-cd5d604d5e0d service nova] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:15 user nova-compute[72990]: DEBUG nova.compute.manager [req-16f866eb-c683-4fe0-9047-45c3e9a8f893 req-25a2bc4a-dc9e-49d9-b7c5-cd5d604d5e0d service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] No waiting events found dispatching network-vif-plugged-0364cc8c-227a-4464-8c2b-9a04f24c568f {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:04:15 user nova-compute[72990]: WARNING nova.compute.manager [req-16f866eb-c683-4fe0-9047-45c3e9a8f893 req-25a2bc4a-dc9e-49d9-b7c5-cd5d604d5e0d service nova] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Received unexpected event network-vif-plugged-0364cc8c-227a-4464-8c2b-9a04f24c568f for instance with vm_state active and task_state deleting.
Aug 27 04:04:15 user nova-compute[72990]: DEBUG nova.objects.instance [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:04:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-57f374e4-4896-4232-b65e-a18440b6969d tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.834s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:15 user nova-compute[72990]: INFO nova.compute.manager [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Took 0.88 seconds to detach 1 volumes for instance.
Aug 27 04:04:15 user nova-compute[72990]: DEBUG nova.compute.manager [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Deleting volume: 59f9b27c-e18f-4f91-991c-c5799681cdc2 {{(pid=72990) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1ba0f12f-5931-4b73-baa2-b4874b5b3a4b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1ba0f12f-5931-4b73-baa2-b4874b5b3a4b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-1ba0f12f-5931-4b73-baa2-b4874b5b3a4b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-1ba0f12f-5931-4b73-baa2-b4874b5b3a4b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72990) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG nova.objects.instance [None req-1ba0f12f-5931-4b73-baa2-b4874b5b3a4b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.volume.cinder [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Update attachment failed for attachment 104636d7-1a8e-4358-a953-4fad41b9f10f. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:e51aceac-0cd7-48b0-ac03-80f6fc907229 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:e51aceac-0cd7-48b0-ac03-80f6fc907229/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 was not found.).). (HTTP 500) (Request-ID: req-1b9e1036-6dc2-48ca-afac-b7ac81fed628) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:e51aceac-0cd7-48b0-ac03-80f6fc907229 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:e51aceac-0cd7-48b0-ac03-80f6fc907229/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 was not found.).). (HTTP 500) (Request-ID: req-1b9e1036-6dc2-48ca-afac-b7ac81fed628)
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Failed to attach e51aceac-0cd7-48b0-ac03-80f6fc907229 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:e51aceac-0cd7-48b0-ac03-80f6fc907229 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:e51aceac-0cd7-48b0-ac03-80f6fc907229/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 was not found.).). (HTTP 500) (Request-ID: req-1b9e1036-6dc2-48ca-afac-b7ac81fed628)
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Traceback (most recent call last):
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     ret_val = method(obj, context, *args, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     self._do_attach(context, instance, volume, volume_api,
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     self._volume_attach(context, volume, connector, instance,
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     connection_info = volume_api.attachment_update(
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     res = method(self, ctx, *args, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     with excutils.save_and_reraise_exception():
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     self.force_reraise()
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     raise self.value
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     context, '3.44', skip_version_check=True).attachments.update(
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     return method.func(obj, *args, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     resp = self._update('/attachments/%s' % id, body)
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     return self._cs_request(url, 'PUT', **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     return self.request(url, method, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730]     raise exceptions.from_response(resp, body)
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:e51aceac-0cd7-48b0-ac03-80f6fc907229 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:e51aceac-0cd7-48b0-ac03-80f6fc907229/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 was not found.).). (HTTP 500) (Request-ID: req-1b9e1036-6dc2-48ca-afac-b7ac81fed628)
Aug 27 04:04:16 user nova-compute[72990]: ERROR nova.compute.manager [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] 
Aug 27 04:04:16 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:16 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Deleted allocations for instance f8dca40d-3064-41ae-9374-6aefe9f2b941
Aug 27 04:04:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.699s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server [None req-b79ac8a5-368f-4c79-9a2f-0aeda1434035 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:e51aceac-0cd7-48b0-ac03-80f6fc907229 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:e51aceac-0cd7-48b0-ac03-80f6fc907229/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 was not found.).). (HTTP 500) (Request-ID: req-1b9e1036-6dc2-48ca-afac-b7ac81fed628)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:e51aceac-0cd7-48b0-ac03-80f6fc907229 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:e51aceac-0cd7-48b0-ac03-80f6fc907229/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:59f9b27c-e18f-4f91-991c-c5799681cdc2 was not found.).). (HTTP 500) (Request-ID: req-1b9e1036-6dc2-48ca-afac-b7ac81fed628)
Aug 27 04:04:16 user nova-compute[72990]: ERROR oslo_messaging.rpc.server 
Aug 27 04:04:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-41be5fab-42a6-4125-8395-f240b302da9d tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "f8dca40d-3064-41ae-9374-6aefe9f2b941" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.474s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:16 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance destroyed successfully.
Aug 27 04:04:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-1ba0f12f-5931-4b73-baa2-b4874b5b3a4b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:04:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1ba0f12f-5931-4b73-baa2-b4874b5b3a4b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.875s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-dfdc16b8-d3d8-4d48-b2a1-c4f47294d7ee req-b38000ec-9fcc-4bbf-aeb9-c97f299b6ea6 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-unplugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:04:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dfdc16b8-d3d8-4d48-b2a1-c4f47294d7ee req-b38000ec-9fcc-4bbf-aeb9-c97f299b6ea6 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dfdc16b8-d3d8-4d48-b2a1-c4f47294d7ee req-b38000ec-9fcc-4bbf-aeb9-c97f299b6ea6 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dfdc16b8-d3d8-4d48-b2a1-c4f47294d7ee req-b38000ec-9fcc-4bbf-aeb9-c97f299b6ea6 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-dfdc16b8-d3d8-4d48-b2a1-c4f47294d7ee req-b38000ec-9fcc-4bbf-aeb9-c97f299b6ea6 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-unplugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:04:17 user nova-compute[72990]: WARNING nova.compute.manager [req-dfdc16b8-d3d8-4d48-b2a1-c4f47294d7ee req-b38000ec-9fcc-4bbf-aeb9-c97f299b6ea6 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-unplugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state stopped and task_state None.
Aug 27 04:04:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-dfdc16b8-d3d8-4d48-b2a1-c4f47294d7ee req-b38000ec-9fcc-4bbf-aeb9-c97f299b6ea6 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:04:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dfdc16b8-d3d8-4d48-b2a1-c4f47294d7ee req-b38000ec-9fcc-4bbf-aeb9-c97f299b6ea6 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dfdc16b8-d3d8-4d48-b2a1-c4f47294d7ee req-b38000ec-9fcc-4bbf-aeb9-c97f299b6ea6 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:17 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dfdc16b8-d3d8-4d48-b2a1-c4f47294d7ee req-b38000ec-9fcc-4bbf-aeb9-c97f299b6ea6 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:17 user nova-compute[72990]: DEBUG nova.compute.manager [req-dfdc16b8-d3d8-4d48-b2a1-c4f47294d7ee req-b38000ec-9fcc-4bbf-aeb9-c97f299b6ea6 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:04:17 user nova-compute[72990]: WARNING nova.compute.manager [req-dfdc16b8-d3d8-4d48-b2a1-c4f47294d7ee req-b38000ec-9fcc-4bbf-aeb9-c97f299b6ea6 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state stopped and task_state None.
Aug 27 04:04:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:29 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109054.021323, f8dca40d-3064-41ae-9374-6aefe9f2b941 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:04:29 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] VM Stopped (Lifecycle Event)
Aug 27 04:04:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-e06a3746-788d-426a-b191-fa3b4d9f7322 None None] [instance: f8dca40d-3064-41ae-9374-6aefe9f2b941] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:04:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:31 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109056.8664076, aef3be9a-fd69-4428-97c3-1016d97ca0e9 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:04:31 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] VM Stopped (Lifecycle Event)
Aug 27 04:04:31 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ba6b663e-7205-420a-a083-251eebc8928a None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:04:31 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ba6b663e-7205-420a-a083-251eebc8928a None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:04:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "861db154-c722-4164-a1eb-5f0bee266356" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "861db154-c722-4164-a1eb-5f0bee266356" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:04:37 user nova-compute[72990]: INFO nova.compute.claims [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Claim successful on node user
Aug 27 04:04:37 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:04:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:04:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG nova.policy [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bc7642afe894fea911c5bd6250e436f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672e3e9fbb0844ada56ef6b665212fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:04:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Creating image(s)
Aug 27 04:04:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "/opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "/opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "/opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:37 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.207s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.205s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk 1073741824" returned: 0 in 0.053s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Successfully created port: 3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Cannot resize image /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Ensure instance console log exists: /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Successfully updated port: 3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "refresh_cache-861db154-c722-4164-a1eb-5f0bee266356" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquired lock "refresh_cache-861db154-c722-4164-a1eb-5f0bee266356" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-ca340606-6a12-43bd-ae8e-53d67f2a165f req-ac6a0536-67b8-4f1c-8381-2192edb6c7fb service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Received event network-changed-3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-ca340606-6a12-43bd-ae8e-53d67f2a165f req-ac6a0536-67b8-4f1c-8381-2192edb6c7fb service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Refreshing instance network info cache due to event network-changed-3b75e34d-7706-4188-9324-0d985e1994a8. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ca340606-6a12-43bd-ae8e-53d67f2a165f req-ac6a0536-67b8-4f1c-8381-2192edb6c7fb service nova] Acquiring lock "refresh_cache-861db154-c722-4164-a1eb-5f0bee266356" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Updating instance_info_cache with network_info: [{"id": "3b75e34d-7706-4188-9324-0d985e1994a8", "address": "fa:16:3e:df:31:d3", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b75e34d-77", "ovs_interfaceid": "3b75e34d-7706-4188-9324-0d985e1994a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Releasing lock "refresh_cache-861db154-c722-4164-a1eb-5f0bee266356" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Instance network_info: |[{"id": "3b75e34d-7706-4188-9324-0d985e1994a8", "address": "fa:16:3e:df:31:d3", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b75e34d-77", "ovs_interfaceid": "3b75e34d-7706-4188-9324-0d985e1994a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ca340606-6a12-43bd-ae8e-53d67f2a165f req-ac6a0536-67b8-4f1c-8381-2192edb6c7fb service nova] Acquired lock "refresh_cache-861db154-c722-4164-a1eb-5f0bee266356" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.network.neutron [req-ca340606-6a12-43bd-ae8e-53d67f2a165f req-ac6a0536-67b8-4f1c-8381-2192edb6c7fb service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Refreshing network info cache for port 3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Start _get_guest_xml network_info=[{"id": "3b75e34d-7706-4188-9324-0d985e1994a8", "address": "fa:16:3e:df:31:d3", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b75e34d-77", "ovs_interfaceid": "3b75e34d-7706-4188-9324-0d985e1994a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:04:39 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:04:39 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1593562022',display_name='tempest-VolumesSnapshotTestJSON-instance-1593562022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1593562022',id=40,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb3QPelBWNfoD5QbxYe2LVgVztGeidW+sVuQyTZ8ajc41/U9irqNI3feV1VhUZB0PDPTdkjgxieGPSJ45wxjvh0DaBRfy2PS7VxR0cBVi28qJzwoGrReqDH749D38MKtg==',key_name='tempest-keypair-42088266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='672e3e9fbb0844ada56ef6b665212fb0',ramdisk_id='',reservation_id='r-x8m0sdlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1409906536',owner_user_name='tempest-VolumesSnapshotTestJSON-1409906536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bc7642afe894fea911c5bd6250e436f',uuid=861db154-c722-4164-a1eb-5f0bee266356,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b75e34d-7706-4188-9324-0d985e1994a8", "address": "fa:16:3e:df:31:d3", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b75e34d-77", "ovs_interfaceid": "3b75e34d-7706-4188-9324-0d985e1994a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Converting VIF {"id": "3b75e34d-7706-4188-9324-0d985e1994a8", "address": "fa:16:3e:df:31:d3", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b75e34d-77", "ovs_interfaceid": "3b75e34d-7706-4188-9324-0d985e1994a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:31:d3,bridge_name='br-int',has_traffic_filtering=True,id=3b75e34d-7706-4188-9324-0d985e1994a8,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b75e34d-77') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lazy-loading 'pci_devices' on Instance uuid 861db154-c722-4164-a1eb-5f0bee266356 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:04:39 user nova-compute[72990]:   <uuid>861db154-c722-4164-a1eb-5f0bee266356</uuid>
Aug 27 04:04:39 user nova-compute[72990]:   <name>instance-00000028</name>
Aug 27 04:04:39 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:04:39 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:04:39 user nova-compute[72990]:   <metadata>
Aug 27 04:04:39 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:04:39 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:04:39 user nova-compute[72990]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1593562022</nova:name>
Aug 27 04:04:39 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:04:39</nova:creationTime>
Aug 27 04:04:39 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:04:39 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:04:39 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:04:39 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:04:39 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:04:39 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:04:39 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:04:39 user nova-compute[72990]:       <nova:owner>
Aug 27 04:04:39 user nova-compute[72990]:         <nova:user uuid="0bc7642afe894fea911c5bd6250e436f">tempest-VolumesSnapshotTestJSON-1409906536-project-member</nova:user>
Aug 27 04:04:39 user nova-compute[72990]:         <nova:project uuid="672e3e9fbb0844ada56ef6b665212fb0">tempest-VolumesSnapshotTestJSON-1409906536</nova:project>
Aug 27 04:04:39 user nova-compute[72990]:       </nova:owner>
Aug 27 04:04:39 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 04:04:39 user nova-compute[72990]:       <nova:ports>
Aug 27 04:04:39 user nova-compute[72990]:         <nova:port uuid="3b75e34d-7706-4188-9324-0d985e1994a8">
Aug 27 04:04:39 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 04:04:39 user nova-compute[72990]:         </nova:port>
Aug 27 04:04:39 user nova-compute[72990]:       </nova:ports>
Aug 27 04:04:39 user nova-compute[72990]:     </nova:instance>
Aug 27 04:04:39 user nova-compute[72990]:   </metadata>
Aug 27 04:04:39 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:04:39 user nova-compute[72990]:     <system>
Aug 27 04:04:39 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:04:39 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:04:39 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:04:39 user nova-compute[72990]:       <entry name="serial">861db154-c722-4164-a1eb-5f0bee266356</entry>
Aug 27 04:04:39 user nova-compute[72990]:       <entry name="uuid">861db154-c722-4164-a1eb-5f0bee266356</entry>
Aug 27 04:04:39 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:04:39 user nova-compute[72990]:     </system>
Aug 27 04:04:39 user nova-compute[72990]:   </sysinfo>
Aug 27 04:04:39 user nova-compute[72990]:   <os>
Aug 27 04:04:39 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:04:39 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:04:39 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:04:39 user nova-compute[72990]:   </os>
Aug 27 04:04:39 user nova-compute[72990]:   <features>
Aug 27 04:04:39 user nova-compute[72990]:     <acpi/>
Aug 27 04:04:39 user nova-compute[72990]:     <apic/>
Aug 27 04:04:39 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:04:39 user nova-compute[72990]:   </features>
Aug 27 04:04:39 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:04:39 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:04:39 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:04:39 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:04:39 user nova-compute[72990]:   </clock>
Aug 27 04:04:39 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:04:39 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:04:39 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:04:39 user nova-compute[72990]:   </cpu>
Aug 27 04:04:39 user nova-compute[72990]:   <devices>
Aug 27 04:04:39 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:04:39 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:04:39 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk"/>
Aug 27 04:04:39 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:04:39 user nova-compute[72990]:     </disk>
Aug 27 04:04:39 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:04:39 user nova-compute[72990]:       <mac address="fa:16:3e:df:31:d3"/>
Aug 27 04:04:39 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:04:39 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:04:39 user nova-compute[72990]:       <target dev="tap3b75e34d-77"/>
Aug 27 04:04:39 user nova-compute[72990]:     </interface>
Aug 27 04:04:39 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:04:39 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/console.log" append="off"/>
Aug 27 04:04:39 user nova-compute[72990]:     </serial>
Aug 27 04:04:39 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:04:39 user nova-compute[72990]:     <video>
Aug 27 04:04:39 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:04:39 user nova-compute[72990]:     </video>
Aug 27 04:04:39 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:04:39 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:04:39 user nova-compute[72990]:     </rng>
Aug 27 04:04:39 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:04:39 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:04:39 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:04:39 user nova-compute[72990]:     </memballoon>
Aug 27 04:04:39 user nova-compute[72990]:   </devices>
Aug 27 04:04:39 user nova-compute[72990]: </domain>
Aug 27 04:04:39 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1593562022',display_name='tempest-VolumesSnapshotTestJSON-instance-1593562022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1593562022',id=40,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb3QPelBWNfoD5QbxYe2LVgVztGeidW+sVuQyTZ8ajc41/U9irqNI3feV1VhUZB0PDPTdkjgxieGPSJ45wxjvh0DaBRfy2PS7VxR0cBVi28qJzwoGrReqDH749D38MKtg==',key_name='tempest-keypair-42088266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='672e3e9fbb0844ada56ef6b665212fb0',ramdisk_id='',reservation_id='r-x8m0sdlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1409906536',owner_user_name='tempest-VolumesSnapshotTestJSON-1409906536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bc7642afe894fea911c5bd6250e436f',uuid=861db154-c722-4164-a1eb-5f0bee266356,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b75e34d-7706-4188-9324-0d985e1994a8", "address": "fa:16:3e:df:31:d3", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b75e34d-77", "ovs_interfaceid": "3b75e34d-7706-4188-9324-0d985e1994a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Converting VIF {"id": "3b75e34d-7706-4188-9324-0d985e1994a8", "address": "fa:16:3e:df:31:d3", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b75e34d-77", "ovs_interfaceid": "3b75e34d-7706-4188-9324-0d985e1994a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:31:d3,bridge_name='br-int',has_traffic_filtering=True,id=3b75e34d-7706-4188-9324-0d985e1994a8,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b75e34d-77') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG os_vif [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:31:d3,bridge_name='br-int',has_traffic_filtering=True,id=3b75e34d-7706-4188-9324-0d985e1994a8,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b75e34d-77') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b75e34d-77, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b75e34d-77, col_values=(('external_ids', {'iface-id': '3b75e34d-7706-4188-9324-0d985e1994a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:31:d3', 'vm-uuid': '861db154-c722-4164-a1eb-5f0bee266356'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:04:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:39 user nova-compute[72990]: INFO os_vif [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:31:d3,bridge_name='br-int',has_traffic_filtering=True,id=3b75e34d-7706-4188-9324-0d985e1994a8,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b75e34d-77')
Aug 27 04:04:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:04:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] No VIF found with MAC fa:16:3e:df:31:d3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:04:40 user nova-compute[72990]: DEBUG nova.network.neutron [req-ca340606-6a12-43bd-ae8e-53d67f2a165f req-ac6a0536-67b8-4f1c-8381-2192edb6c7fb service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Updated VIF entry in instance network info cache for port 3b75e34d-7706-4188-9324-0d985e1994a8. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:04:40 user nova-compute[72990]: DEBUG nova.network.neutron [req-ca340606-6a12-43bd-ae8e-53d67f2a165f req-ac6a0536-67b8-4f1c-8381-2192edb6c7fb service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Updating instance_info_cache with network_info: [{"id": "3b75e34d-7706-4188-9324-0d985e1994a8", "address": "fa:16:3e:df:31:d3", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b75e34d-77", "ovs_interfaceid": "3b75e34d-7706-4188-9324-0d985e1994a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:04:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ca340606-6a12-43bd-ae8e-53d67f2a165f req-ac6a0536-67b8-4f1c-8381-2192edb6c7fb service nova] Releasing lock "refresh_cache-861db154-c722-4164-a1eb-5f0bee266356" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:04:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:04:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:04:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-9dbd83f8-ab36-4f59-851a-75ab781cf3d2 req-538c49b9-b93d-406d-8a77-400988065d8c service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Received event network-vif-plugged-3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:04:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9dbd83f8-ab36-4f59-851a-75ab781cf3d2 req-538c49b9-b93d-406d-8a77-400988065d8c service nova] Acquiring lock "861db154-c722-4164-a1eb-5f0bee266356-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9dbd83f8-ab36-4f59-851a-75ab781cf3d2 req-538c49b9-b93d-406d-8a77-400988065d8c service nova] Lock "861db154-c722-4164-a1eb-5f0bee266356-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9dbd83f8-ab36-4f59-851a-75ab781cf3d2 req-538c49b9-b93d-406d-8a77-400988065d8c service nova] Lock "861db154-c722-4164-a1eb-5f0bee266356-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-9dbd83f8-ab36-4f59-851a-75ab781cf3d2 req-538c49b9-b93d-406d-8a77-400988065d8c service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] No waiting events found dispatching network-vif-plugged-3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:04:41 user nova-compute[72990]: WARNING nova.compute.manager [req-9dbd83f8-ab36-4f59-851a-75ab781cf3d2 req-538c49b9-b93d-406d-8a77-400988065d8c service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Received unexpected event network-vif-plugged-3b75e34d-7706-4188-9324-0d985e1994a8 for instance with vm_state building and task_state spawning.
Aug 27 04:04:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109083.5535045, 861db154-c722-4164-a1eb-5f0bee266356 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:04:43 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 861db154-c722-4164-a1eb-5f0bee266356] VM Resumed (Lifecycle Event)
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:04:43 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Instance spawned successfully.
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:04:43 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 861db154-c722-4164-a1eb-5f0bee266356] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109083.555116, 861db154-c722-4164-a1eb-5f0bee266356 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:04:43 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 861db154-c722-4164-a1eb-5f0bee266356] VM Started (Lifecycle Event)
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:04:43 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 861db154-c722-4164-a1eb-5f0bee266356] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:04:43 user nova-compute[72990]: INFO nova.compute.manager [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Took 5.84 seconds to spawn the instance on the hypervisor.
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-318428ff-b6de-42f4-987f-f3e4b8717486 req-186f8035-8ca5-473d-b4f5-d563f41f2ae1 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Received event network-vif-plugged-3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-318428ff-b6de-42f4-987f-f3e4b8717486 req-186f8035-8ca5-473d-b4f5-d563f41f2ae1 service nova] Acquiring lock "861db154-c722-4164-a1eb-5f0bee266356-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-318428ff-b6de-42f4-987f-f3e4b8717486 req-186f8035-8ca5-473d-b4f5-d563f41f2ae1 service nova] Lock "861db154-c722-4164-a1eb-5f0bee266356-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-318428ff-b6de-42f4-987f-f3e4b8717486 req-186f8035-8ca5-473d-b4f5-d563f41f2ae1 service nova] Lock "861db154-c722-4164-a1eb-5f0bee266356-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.compute.manager [req-318428ff-b6de-42f4-987f-f3e4b8717486 req-186f8035-8ca5-473d-b4f5-d563f41f2ae1 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] No waiting events found dispatching network-vif-plugged-3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:04:43 user nova-compute[72990]: WARNING nova.compute.manager [req-318428ff-b6de-42f4-987f-f3e4b8717486 req-186f8035-8ca5-473d-b4f5-d563f41f2ae1 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Received unexpected event network-vif-plugged-3b75e34d-7706-4188-9324-0d985e1994a8 for instance with vm_state building and task_state spawning.
Aug 27 04:04:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:43 user nova-compute[72990]: INFO nova.compute.manager [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Terminating instance
Aug 27 04:04:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:04:43 user nova-compute[72990]: INFO nova.compute.manager [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Took 6.62 seconds to build instance.
Aug 27 04:04:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d72a90e-f951-4d51-83cf-907176f76de1 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "861db154-c722-4164-a1eb-5f0bee266356" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.749s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-36b63650-d73f-4ed2-98bf-7f35e6995e35 req-7763dedd-d84b-44a5-ac64-af2cc254ea5f service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Received event network-vif-unplugged-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-36b63650-d73f-4ed2-98bf-7f35e6995e35 req-7763dedd-d84b-44a5-ac64-af2cc254ea5f service nova] Acquiring lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-36b63650-d73f-4ed2-98bf-7f35e6995e35 req-7763dedd-d84b-44a5-ac64-af2cc254ea5f service nova] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-36b63650-d73f-4ed2-98bf-7f35e6995e35 req-7763dedd-d84b-44a5-ac64-af2cc254ea5f service nova] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-36b63650-d73f-4ed2-98bf-7f35e6995e35 req-7763dedd-d84b-44a5-ac64-af2cc254ea5f service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] No waiting events found dispatching network-vif-unplugged-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-36b63650-d73f-4ed2-98bf-7f35e6995e35 req-7763dedd-d84b-44a5-ac64-af2cc254ea5f service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Received event network-vif-unplugged-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:04:44 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Instance destroyed successfully.
Aug 27 04:04:44 user nova-compute[72990]: DEBUG nova.objects.instance [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lazy-loading 'resources' on Instance uuid eeaea5e8-16c9-4a0d-b296-e883311331ac {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-531191223',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-531191223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5311912',id=36,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7yQo13t5Mf+W4votkNtmuBMOlO1zK08P8/Ymaw++SIpC6Uv7rmjWMYs3qJ4aoWW26ieuNmyXGHegJ0Jq4IlERg1DAwO331OSKTn3DxfrJMRm5huopyn2nVE9bdZqWgBA==',key_name='tempest-keypair-1583905272',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:01:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='591e030390fe4f76803a298194788068',ramdisk_id='',reservation_id='r-v1308e90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1531810617',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:01:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49273c77b235424a8dc317decffa357d',uuid=eeaea5e8-16c9-4a0d-b296-e883311331ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "address": "fa:16:3e:07:44:36", "network": {"id": "f6683e38-2ada-42b7-bf0b-5437286bb052", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1399247984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "591e030390fe4f76803a298194788068", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9198f9ec-e8", "ovs_interfaceid": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Converting VIF {"id": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "address": "fa:16:3e:07:44:36", "network": {"id": "f6683e38-2ada-42b7-bf0b-5437286bb052", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1399247984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "591e030390fe4f76803a298194788068", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9198f9ec-e8", "ovs_interfaceid": "9198f9ec-e89a-4cde-81fe-e8156d77c6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:44:36,bridge_name='br-int',has_traffic_filtering=True,id=9198f9ec-e89a-4cde-81fe-e8156d77c6b8,network=Network(f6683e38-2ada-42b7-bf0b-5437286bb052),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9198f9ec-e8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG os_vif [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:44:36,bridge_name='br-int',has_traffic_filtering=True,id=9198f9ec-e89a-4cde-81fe-e8156d77c6b8,network=Network(f6683e38-2ada-42b7-bf0b-5437286bb052),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9198f9ec-e8') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9198f9ec-e8, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:44 user nova-compute[72990]: INFO os_vif [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:44:36,bridge_name='br-int',has_traffic_filtering=True,id=9198f9ec-e89a-4cde-81fe-e8156d77c6b8,network=Network(f6683e38-2ada-42b7-bf0b-5437286bb052),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9198f9ec-e8')
Aug 27 04:04:44 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Deleting instance files /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac_del
Aug 27 04:04:44 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Deletion of /opt/stack/data/nova/instances/eeaea5e8-16c9-4a0d-b296-e883311331ac_del complete
Aug 27 04:04:44 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:04:44 user nova-compute[72990]: INFO nova.compute.manager [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 27 04:04:44 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:04:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:04:46 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Took 1.41 seconds to deallocate network for instance.
Aug 27 04:04:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-b5674bee-afcf-4507-924a-6c040ce79f42 req-65c03795-f70c-459d-a49b-09a864e02f5f service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Received event network-vif-plugged-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b5674bee-afcf-4507-924a-6c040ce79f42 req-65c03795-f70c-459d-a49b-09a864e02f5f service nova] Acquiring lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b5674bee-afcf-4507-924a-6c040ce79f42 req-65c03795-f70c-459d-a49b-09a864e02f5f service nova] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b5674bee-afcf-4507-924a-6c040ce79f42 req-65c03795-f70c-459d-a49b-09a864e02f5f service nova] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-b5674bee-afcf-4507-924a-6c040ce79f42 req-65c03795-f70c-459d-a49b-09a864e02f5f service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] No waiting events found dispatching network-vif-plugged-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:04:46 user nova-compute[72990]: WARNING nova.compute.manager [req-b5674bee-afcf-4507-924a-6c040ce79f42 req-65c03795-f70c-459d-a49b-09a864e02f5f service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Received unexpected event network-vif-plugged-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 for instance with vm_state active and task_state deleting.
Aug 27 04:04:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-b5674bee-afcf-4507-924a-6c040ce79f42 req-65c03795-f70c-459d-a49b-09a864e02f5f service nova] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Received event network-vif-deleted-9198f9ec-e89a-4cde-81fe-e8156d77c6b8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:46 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Deleted allocations for instance eeaea5e8-16c9-4a0d-b296-e883311331ac
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-cc51ae93-acd5-4b0e-b2eb-d912f9fee5b9 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617 tempest-TestServerVolumeAttachScenarioOldVersion-1531810617-project-member] Lock "eeaea5e8-16c9-4a0d-b296-e883311331ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.995s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:04:47 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:04:47 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:04:47 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8194MB free_disk=25.167709350585938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ae9e24d9-20e5-4642-b6d3-de298c138730 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance da3f86d1-09e4-4c85-b275-145c86f1aa15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 861db154-c722-4164-a1eb-5f0bee266356 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:04:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:04:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:48 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:04:48 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:04:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:04:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:04:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:04:48 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:04:49 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Updating instance_info_cache with network_info: [{"id": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "address": "fa:16:3e:32:2f:f1", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe52f47f-bf", "ovs_interfaceid": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:04:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:04:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:04:49 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:04:49 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:04:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:04:59 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109084.537168, eeaea5e8-16c9-4a0d-b296-e883311331ac => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:04:59 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] VM Stopped (Lifecycle Event)
Aug 27 04:04:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-79e0255e-9ae4-439d-a3e8-23fa953e4fa0 None None] [instance: eeaea5e8-16c9-4a0d-b296-e883311331ac] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:04:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:12 user nova-compute[72990]: DEBUG nova.compute.manager [req-bc12e299-645d-48df-8964-a1e4647b787f req-1dc26f1d-a9ab-4639-9fe3-4f51ed4fc0b4 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Received event network-changed-449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:05:12 user nova-compute[72990]: DEBUG nova.compute.manager [req-bc12e299-645d-48df-8964-a1e4647b787f req-1dc26f1d-a9ab-4639-9fe3-4f51ed4fc0b4 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Refreshing instance network info cache due to event network-changed-449158a8-0249-4545-98c9-ecfccbcc1148. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:05:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bc12e299-645d-48df-8964-a1e4647b787f req-1dc26f1d-a9ab-4639-9fe3-4f51ed4fc0b4 service nova] Acquiring lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:05:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bc12e299-645d-48df-8964-a1e4647b787f req-1dc26f1d-a9ab-4639-9fe3-4f51ed4fc0b4 service nova] Acquired lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:05:12 user nova-compute[72990]: DEBUG nova.network.neutron [req-bc12e299-645d-48df-8964-a1e4647b787f req-1dc26f1d-a9ab-4639-9fe3-4f51ed4fc0b4 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Refreshing network info cache for port 449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:05:12 user nova-compute[72990]: DEBUG nova.network.neutron [req-bc12e299-645d-48df-8964-a1e4647b787f req-1dc26f1d-a9ab-4639-9fe3-4f51ed4fc0b4 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updated VIF entry in instance network info cache for port 449158a8-0249-4545-98c9-ecfccbcc1148. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:05:12 user nova-compute[72990]: DEBUG nova.network.neutron [req-bc12e299-645d-48df-8964-a1e4647b787f req-1dc26f1d-a9ab-4639-9fe3-4f51ed4fc0b4 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updating instance_info_cache with network_info: [{"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:05:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bc12e299-645d-48df-8964-a1e4647b787f req-1dc26f1d-a9ab-4639-9fe3-4f51ed4fc0b4 service nova] Releasing lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:05:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:05:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:05:13 user nova-compute[72990]: DEBUG nova.objects.instance [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lazy-loading 'flavor' on Instance uuid da3f86d1-09e4-4c85-b275-145c86f1aa15 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:05:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:05:14 user nova-compute[72990]: INFO nova.compute.manager [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Attaching volume de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf to /dev/vdb
Aug 27 04:05:14 user nova-compute[72990]: DEBUG os_brick.utils [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4189a2c-b7f6-4104-9197-4577bbf35026]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d32c542-7b06-4ccc-831f-027059b36941]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c821e7cc-4776-4f77-a115-47e2f2e5b06b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb0c928-eae1-4385-a12a-70a10818ab66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:05:14 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:05:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabcc697-6c2d-426c-98ff-3d67876498ef]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG os_brick.utils [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updating existing volume attachment record: 6fec6bb5-4b12-434b-a572-abced76ec484 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:05:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:05:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfHvBbWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:05:24 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:05:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:05:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:05:24 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:05:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:05:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:05:24 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:05:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fc594b-3b0f-49c9-b25e-24acb2b7e0d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:05:24 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4d16d1-6a01-4e7a-8356-ae32de523430]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf] added
Aug 27 04:05:25 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0b2603-97f5-4794-b1bf-f9a940145681]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[faea074a-16d2-4218-b197-51c76a249dd4]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfHvBbWA {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfHvBbWA" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfaed72-4b85-4a4d-b6e6-41b19dffe49e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DfHvBbWA'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f83532-89d9-4bbf-8afc-d5ffdbe376d1]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfce6ec-7e63-4fec-9b01-761612a486a5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 04:05:25 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 04:05:25 user nova-compute[72990]:  {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:05:25 user nova-compute[72990]: WARNING os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 04:05:25 user nova-compute[72990]: 
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b0a4f3-45f5-47aa-99b0-66d35f473a53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf, portal: 172.16.0.220,3260]
Aug 27 04:05:25 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf, portal: 172.16.0.220,3260] successful.
Aug 27 04:05:25 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[315a7f04-71ee-4843-b7da-20dd818fc843]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b0c900-43cb-4d0a-8193-95fc99ced3f9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf (non-flash)
Aug 27 04:05:25 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf (non-flash)
Aug 27 04:05:25 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9515586-a2bc-4729-9aab-7112adb21cb5]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:25 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:05:26 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:05:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfHvBbWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:05:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:05:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23432653765363437', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:05:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432653765363437', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:05:26 user nova-compute[72990]: DEBUG nova.objects.instance [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lazy-loading 'flavor' on Instance uuid da3f86d1-09e4-4c85-b275-145c86f1aa15 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:05:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:05:26 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:05:26 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:05:26 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:05:26 user nova-compute[72990]:   <serial>de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf</serial>
Aug 27 04:05:26 user nova-compute[72990]: </disk>
Aug 27 04:05:26 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:05:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:05:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:05:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] No VIF found with MAC fa:16:3e:6d:c0:a1, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:05:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e11658e6-dae1-4955-ba64-0441d9167c9a tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.886s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:05:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:05:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:05:29 user nova-compute[72990]: INFO nova.compute.manager [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Detaching volume de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf
Aug 27 04:05:29 user nova-compute[72990]: INFO nova.virt.block_device [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Attempting to driver detach volume de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf from mountpoint /dev/vdb
Aug 27 04:05:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Attempting to detach device vdb from instance da3f86d1-09e4-4c85-b275-145c86f1aa15 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:05:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:05:29 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:05:29 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:05:29 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:05:29 user nova-compute[72990]:   <serial>de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf</serial>
Aug 27 04:05:29 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:05:29 user nova-compute[72990]: </disk>
Aug 27 04:05:29 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:05:29 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Successfully detached device vdb from instance da3f86d1-09e4-4c85-b275-145c86f1aa15 from the persistent domain config.
Aug 27 04:05:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da3f86d1-09e4-4c85-b275-145c86f1aa15 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:05:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:05:29 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:05:29 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:05:29 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:05:29 user nova-compute[72990]:   <serial>de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf</serial>
Aug 27 04:05:29 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:05:29 user nova-compute[72990]: </disk>
Aug 27 04:05:29 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693109130.146853, da3f86d1-09e4-4c85-b275-145c86f1aa15 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da3f86d1-09e4-4c85-b275-145c86f1aa15 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:05:30 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Successfully detached device vdb from instance da3f86d1-09e4-4c85-b275-145c86f1aa15 from the live domain config.
Aug 27 04:05:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfHvBbWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:05:30 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c64717-8c74-42e4-942b-eef8af394a1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdacfec8-293b-4851-a17e-a3e8cece17af]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf (non-flash)
Aug 27 04:05:30 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf (non-flash)
Aug 27 04:05:30 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44dfc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b34a25-1978-4b94-8ce4-c07cb9462cf5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21fba0b-5633-413e-a9bc-cbc2920cddb3]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc22d02-c7bf-42ae-8404-5fb145d0329b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae01bc85-95f7-4fc3-b364-38fe683ac90c]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcba976e-881e-4467-8ecd-9b519f59ce9a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e535a4-5d83-4c0b-b02d-01133e617194]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf, portal: 172.16.0.220,3260]
Aug 27 04:05:30 user nova-compute[72990]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf, portal: 172.16.0.220,3260] successful.
Aug 27 04:05:30 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de11b6db-1ccb-4f88-9d6d-9fb5e0464ccf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6726b1f-b899-48ae-b0c8-99e03f88e9e0]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] <== disconnect_volume: return (284ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:05:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:05:31 user nova-compute[72990]: DEBUG nova.objects.instance [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lazy-loading 'flavor' on Instance uuid da3f86d1-09e4-4c85-b275-145c86f1aa15 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:05:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-82c69510-6d94-49dd-9c25-12e85ed31535 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.737s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:05:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:05:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:05:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:05:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:05:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:05:32 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:05:32 user nova-compute[72990]: INFO nova.compute.claims [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Claim successful on node user
Aug 27 04:05:32 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:05:32 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:05:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:05:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:05:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:05:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:05:32 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:05:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:05:32 user nova-compute[72990]: INFO nova.virt.block_device [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Booting with volume dc13f7b0-0c8a-4393-992a-7bfb661ddf3c at /dev/vda
Aug 27 04:05:33 user nova-compute[72990]: DEBUG nova.policy [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf3112e616344af7873a50d134260637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6b19a372f947e4aee43f9d7573e8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG os_brick.utils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a19166-956a-4e0b-8ef9-cda490eff2e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0eb8338-8bbc-474b-b878-0ccd20f72850]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fabee3-b360-4ef1-a0f5-138424338ec5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[591bec07-8f6c-40cc-8531-33bc2b2835a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:05:33 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:05:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c59f2f1-d999-4eaa-838c-016c172d155e]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG os_brick.utils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Updating existing volume attachment record: 704a45a7-5aee-4805-8d34-787cec94dfb5 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:05:33 user nova-compute[72990]: DEBUG nova.network.neutron [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Successfully created port: 1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG nova.network.neutron [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Successfully updated port: 1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "refresh_cache-0206498e-6ec9-4af7-a4bb-ea512b71e4be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquired lock "refresh_cache-0206498e-6ec9-4af7-a4bb-ea512b71e4be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG nova.network.neutron [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-997ed4ac-6316-4e39-8d76-74a2155661fb req-a481935c-27d4-4596-a8ae-3d13e03860dd service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Received event network-changed-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-997ed4ac-6316-4e39-8d76-74a2155661fb req-a481935c-27d4-4596-a8ae-3d13e03860dd service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Refreshing instance network info cache due to event network-changed-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-997ed4ac-6316-4e39-8d76-74a2155661fb req-a481935c-27d4-4596-a8ae-3d13e03860dd service nova] Acquiring lock "refresh_cache-0206498e-6ec9-4af7-a4bb-ea512b71e4be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG nova.network.neutron [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG nova.network.neutron [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Updating instance_info_cache with network_info: [{"id": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "address": "fa:16:3e:d1:9d:84", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1563d87c-b7", "ovs_interfaceid": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Releasing lock "refresh_cache-0206498e-6ec9-4af7-a4bb-ea512b71e4be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Instance network_info: |[{"id": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "address": "fa:16:3e:d1:9d:84", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1563d87c-b7", "ovs_interfaceid": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-997ed4ac-6316-4e39-8d76-74a2155661fb req-a481935c-27d4-4596-a8ae-3d13e03860dd service nova] Acquired lock "refresh_cache-0206498e-6ec9-4af7-a4bb-ea512b71e4be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:05:34 user nova-compute[72990]: DEBUG nova.network.neutron [req-997ed4ac-6316-4e39-8d76-74a2155661fb req-a481935c-27d4-4596-a8ae-3d13e03860dd service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Refreshing network info cache for port 1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:05:35 user nova-compute[72990]: DEBUG nova.network.neutron [req-997ed4ac-6316-4e39-8d76-74a2155661fb req-a481935c-27d4-4596-a8ae-3d13e03860dd service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Updated VIF entry in instance network info cache for port 1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:05:35 user nova-compute[72990]: DEBUG nova.network.neutron [req-997ed4ac-6316-4e39-8d76-74a2155661fb req-a481935c-27d4-4596-a8ae-3d13e03860dd service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Updating instance_info_cache with network_info: [{"id": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "address": "fa:16:3e:d1:9d:84", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1563d87c-b7", "ovs_interfaceid": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:05:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-997ed4ac-6316-4e39-8d76-74a2155661fb req-a481935c-27d4-4596-a8ae-3d13e03860dd service nova] Releasing lock "refresh_cache-0206498e-6ec9-4af7-a4bb-ea512b71e4be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:05:37 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:05:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:05:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:05:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:05:44 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Creating image(s)
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Ensure instance console log exists: /opt/stack/data/nova/instances/0206498e-6ec9-4af7-a4bb-ea512b71e4be/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Start _get_guest_xml network_info=[{"id": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "address": "fa:16:3e:d1:9d:84", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1563d87c-b7", "ovs_interfaceid": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '704a45a7-5aee-4805-8d34-787cec94dfb5', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqQBUKmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0206498e-6ec9-4af7-a4bb-ea512b71e4be', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc13f7b0-0c8a-4393-992a-7bfb661ddf3c', 'serial': 'dc13f7b0-0c8a-4393-992a-7bfb661ddf3c'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:05:44 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:05:44 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqQBUKmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:05:44 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:05:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:05:44 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:05:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:05:44 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c4f57f-f570-4c15-b46a-86eb8c03986a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:05:44 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f726e0fe-1a84-455a-8409-2539e847579a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c] added
Aug 27 04:05:44 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69ebcef-1198-48f0-9205-7ed4db4da5fe]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c3254e-be7b-444b-a98a-7d06461d59e5]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wqQBUKmE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wqQBUKmE" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d3d104-8704-49b6-a26c-02996fb19e15]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wqQBUKmE'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1495d1-2420-4c2e-8c0c-bd814e679d5c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fb5fde-2396-4e6c-a134-ad562ec8b553]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 04:05:45 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 04:05:45 user nova-compute[72990]:  {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:05:45 user nova-compute[72990]: WARNING os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 04:05:45 user nova-compute[72990]: 
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfcf6b9-2caf-4270-b34c-e0ffdd3a5312]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c, portal: 172.16.0.220,3260]
Aug 27 04:05:45 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c, portal: 172.16.0.220,3260] successful.
Aug 27 04:05:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e117d7a-6ff5-4d20-8d1a-4532bff8e093]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e93b9d5-33b3-4c1d-90d8-64bc867cc1ba]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:05:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:05:45 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f054b88-d7dc-4516-ba66-3d22a45c9998]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqQBUKmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:45 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26532653062373438', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532653062373438', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-359727757',display_name='tempest-TestVolumeBootPattern-volume-backed-server-359727757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-359727757',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALjER765KgqLrzDxo8VaGe/D8luY+wrGAccnvTzMRQQKIX5gFAK28LkVvUTbh8GucXsSYgkXpFWvOJy+1D6MbyZm0WMYDAAQh744EP6FKvyxjnKejNZqtxmW9yCoO9bMQ==',key_name='tempest-keypair-1971179342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-z7nmp7ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf3112e616344af7873a50d134260637',uuid=0206498e-6ec9-4af7-a4bb-ea512b71e4be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "address": "fa:16:3e:d1:9d:84", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1563d87c-b7", "ovs_interfaceid": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "address": "fa:16:3e:d1:9d:84", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1563d87c-b7", "ovs_interfaceid": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1563d87c-b7') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG nova.objects.instance [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lazy-loading 'pci_devices' on Instance uuid 0206498e-6ec9-4af7-a4bb-ea512b71e4be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:05:46 user nova-compute[72990]:   <uuid>0206498e-6ec9-4af7-a4bb-ea512b71e4be</uuid>
Aug 27 04:05:46 user nova-compute[72990]:   <name>instance-00000029</name>
Aug 27 04:05:46 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:05:46 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:05:46 user nova-compute[72990]:   <metadata>
Aug 27 04:05:46 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:05:46 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:05:46 user nova-compute[72990]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-359727757</nova:name>
Aug 27 04:05:46 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:05:44</nova:creationTime>
Aug 27 04:05:46 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:05:46 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:05:46 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:05:46 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:05:46 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:05:46 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:05:46 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:05:46 user nova-compute[72990]:       <nova:owner>
Aug 27 04:05:46 user nova-compute[72990]:         <nova:user uuid="cf3112e616344af7873a50d134260637">tempest-TestVolumeBootPattern-1834919775-project-member</nova:user>
Aug 27 04:05:46 user nova-compute[72990]:         <nova:project uuid="6d6b19a372f947e4aee43f9d7573e8f7">tempest-TestVolumeBootPattern-1834919775</nova:project>
Aug 27 04:05:46 user nova-compute[72990]:       </nova:owner>
Aug 27 04:05:46 user nova-compute[72990]:       <nova:ports>
Aug 27 04:05:46 user nova-compute[72990]:         <nova:port uuid="1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb">
Aug 27 04:05:46 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 04:05:46 user nova-compute[72990]:         </nova:port>
Aug 27 04:05:46 user nova-compute[72990]:       </nova:ports>
Aug 27 04:05:46 user nova-compute[72990]:     </nova:instance>
Aug 27 04:05:46 user nova-compute[72990]:   </metadata>
Aug 27 04:05:46 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:05:46 user nova-compute[72990]:     <system>
Aug 27 04:05:46 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:05:46 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:05:46 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:05:46 user nova-compute[72990]:       <entry name="serial">0206498e-6ec9-4af7-a4bb-ea512b71e4be</entry>
Aug 27 04:05:46 user nova-compute[72990]:       <entry name="uuid">0206498e-6ec9-4af7-a4bb-ea512b71e4be</entry>
Aug 27 04:05:46 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:05:46 user nova-compute[72990]:     </system>
Aug 27 04:05:46 user nova-compute[72990]:   </sysinfo>
Aug 27 04:05:46 user nova-compute[72990]:   <os>
Aug 27 04:05:46 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:05:46 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:05:46 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:05:46 user nova-compute[72990]:   </os>
Aug 27 04:05:46 user nova-compute[72990]:   <features>
Aug 27 04:05:46 user nova-compute[72990]:     <acpi/>
Aug 27 04:05:46 user nova-compute[72990]:     <apic/>
Aug 27 04:05:46 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:05:46 user nova-compute[72990]:   </features>
Aug 27 04:05:46 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:05:46 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:05:46 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:05:46 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:05:46 user nova-compute[72990]:   </clock>
Aug 27 04:05:46 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:05:46 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:05:46 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:05:46 user nova-compute[72990]:   </cpu>
Aug 27 04:05:46 user nova-compute[72990]:   <devices>
Aug 27 04:05:46 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 04:05:46 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:05:46 user nova-compute[72990]:       <source dev="/dev/sdb"/>
Aug 27 04:05:46 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:05:46 user nova-compute[72990]:       <serial>dc13f7b0-0c8a-4393-992a-7bfb661ddf3c</serial>
Aug 27 04:05:46 user nova-compute[72990]:     </disk>
Aug 27 04:05:46 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:05:46 user nova-compute[72990]:       <mac address="fa:16:3e:d1:9d:84"/>
Aug 27 04:05:46 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:05:46 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:05:46 user nova-compute[72990]:       <target dev="tap1563d87c-b7"/>
Aug 27 04:05:46 user nova-compute[72990]:     </interface>
Aug 27 04:05:46 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:05:46 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/0206498e-6ec9-4af7-a4bb-ea512b71e4be/console.log" append="off"/>
Aug 27 04:05:46 user nova-compute[72990]:     </serial>
Aug 27 04:05:46 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:05:46 user nova-compute[72990]:     <video>
Aug 27 04:05:46 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:05:46 user nova-compute[72990]:     </video>
Aug 27 04:05:46 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:05:46 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:05:46 user nova-compute[72990]:     </rng>
Aug 27 04:05:46 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:05:46 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:05:46 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:05:46 user nova-compute[72990]:     </memballoon>
Aug 27 04:05:46 user nova-compute[72990]:   </devices>
Aug 27 04:05:46 user nova-compute[72990]: </domain>
Aug 27 04:05:46 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-359727757',display_name='tempest-TestVolumeBootPattern-volume-backed-server-359727757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-359727757',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALjER765KgqLrzDxo8VaGe/D8luY+wrGAccnvTzMRQQKIX5gFAK28LkVvUTbh8GucXsSYgkXpFWvOJy+1D6MbyZm0WMYDAAQh744EP6FKvyxjnKejNZqtxmW9yCoO9bMQ==',key_name='tempest-keypair-1971179342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-z7nmp7ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf3112e616344af7873a50d134260637',uuid=0206498e-6ec9-4af7-a4bb-ea512b71e4be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "address": "fa:16:3e:d1:9d:84", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1563d87c-b7", "ovs_interfaceid": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "address": "fa:16:3e:d1:9d:84", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1563d87c-b7", "ovs_interfaceid": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1563d87c-b7') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG os_vif [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1563d87c-b7') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1563d87c-b7, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1563d87c-b7, col_values=(('external_ids', {'iface-id': '1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:9d:84', 'vm-uuid': '0206498e-6ec9-4af7-a4bb-ea512b71e4be'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:46 user nova-compute[72990]: INFO os_vif [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1563d87c-b7')
Aug 27 04:05:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] No VIF found with MAC fa:16:3e:d1:9d:84, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:46 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:05:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109149.8423274, 0206498e-6ec9-4af7-a4bb-ea512b71e4be => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:05:50 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] VM Resumed (Lifecycle Event)
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-51fed53f-dff1-42d9-8b59-16e970102c44 req-498c363a-39c0-4957-9d31-6b96d00528a3 service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Received event network-vif-plugged-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-51fed53f-dff1-42d9-8b59-16e970102c44 req-498c363a-39c0-4957-9d31-6b96d00528a3 service nova] Acquiring lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-51fed53f-dff1-42d9-8b59-16e970102c44 req-498c363a-39c0-4957-9d31-6b96d00528a3 service nova] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-51fed53f-dff1-42d9-8b59-16e970102c44 req-498c363a-39c0-4957-9d31-6b96d00528a3 service nova] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-51fed53f-dff1-42d9-8b59-16e970102c44 req-498c363a-39c0-4957-9d31-6b96d00528a3 service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] No waiting events found dispatching network-vif-plugged-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:05:50 user nova-compute[72990]: WARNING nova.compute.manager [req-51fed53f-dff1-42d9-8b59-16e970102c44 req-498c363a-39c0-4957-9d31-6b96d00528a3 service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Received unexpected event network-vif-plugged-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb for instance with vm_state building and task_state spawning.
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-9ce94e79-0c83-422b-95f9-2569f7c58900 req-1f3dc1f5-0aac-4904-801b-54b45cc19987 service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Received event network-vif-plugged-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9ce94e79-0c83-422b-95f9-2569f7c58900 req-1f3dc1f5-0aac-4904-801b-54b45cc19987 service nova] Acquiring lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9ce94e79-0c83-422b-95f9-2569f7c58900 req-1f3dc1f5-0aac-4904-801b-54b45cc19987 service nova] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9ce94e79-0c83-422b-95f9-2569f7c58900 req-1f3dc1f5-0aac-4904-801b-54b45cc19987 service nova] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.manager [req-9ce94e79-0c83-422b-95f9-2569f7c58900 req-1f3dc1f5-0aac-4904-801b-54b45cc19987 service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] No waiting events found dispatching network-vif-plugged-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:05:50 user nova-compute[72990]: WARNING nova.compute.manager [req-9ce94e79-0c83-422b-95f9-2569f7c58900 req-1f3dc1f5-0aac-4904-801b-54b45cc19987 service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Received unexpected event network-vif-plugged-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb for instance with vm_state building and task_state spawning.
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:05:50 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:05:50 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8127MB free_disk=25.135616302490234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:05:50 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Instance spawned successfully.
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:05:50 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109149.8438058, 0206498e-6ec9-4af7-a4bb-ea512b71e4be => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:05:50 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] VM Started (Lifecycle Event)
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ae9e24d9-20e5-4642-b6d3-de298c138730 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance da3f86d1-09e4-4c85-b275-145c86f1aa15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 861db154-c722-4164-a1eb-5f0bee266356 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 0206498e-6ec9-4af7-a4bb-ea512b71e4be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:05:50 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:05:50 user nova-compute[72990]: INFO nova.compute.manager [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:05:50 user nova-compute[72990]: INFO nova.compute.manager [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Took 18.35 seconds to build instance.
Aug 27 04:05:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-85d542d7-0a2c-447a-85ec-37f67ff449e0 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.464s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:05:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.696s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:05:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:51 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:05:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:05:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-ae9e24d9-20e5-4642-b6d3-de298c138730" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:05:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-ae9e24d9-20e5-4642-b6d3-de298c138730" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:05:52 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:05:53 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Updating instance_info_cache with network_info: [{"id": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "address": "fa:16:3e:8b:f2:b3", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a7414a-b2", "ovs_interfaceid": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:05:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-ae9e24d9-20e5-4642-b6d3-de298c138730" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:05:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:05:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:05:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:05:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:05:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:05:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:06:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:06:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:06:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:06:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:07 user nova-compute[72990]: DEBUG nova.objects.instance [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:06:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:06:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquired lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:06:07 user nova-compute[72990]: DEBUG nova.network.neutron [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:06:07 user nova-compute[72990]: DEBUG nova.objects.instance [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'info_cache' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:06:07 user nova-compute[72990]: DEBUG nova.objects.base [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.network.neutron [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updating instance_info_cache with network_info: [{"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Releasing lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:06:08 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance destroyed successfully.
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.objects.instance [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'resources' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.objects.base [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache,resources {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1823636413',display_name='tempest-AttachVolumeTestJSON-server-1823636413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1823636413',id=32,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZNGdZSsfPtAguFJDKN3iVgvVi0aLXdyqROhiDmpQVPMLbPrj6LNqo6zh2eRkFzKq35WCkDJ3pahxf33JmxUgZuGyUraQp1NA3CDVXGmGeP0bYPK2BVWcRuq13QnqVJqg==',key_name='tempest-keypair-1602283704',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:58:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e2d0a8267a0042a0ad831e7b91889dc7',ramdisk_id='',reservation_id='r-2qv66d4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-698620353',owner_user_name='tempest-AttachVolumeTestJSON-698620353-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5711f5c9c8344de79b246e7eb8661ff2',uuid=aef3be9a-fd69-4428-97c3-1016d97ca0e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converting VIF {"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG os_vif [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35d5b0ac-30, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:06:08 user nova-compute[72990]: INFO os_vif [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30')
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Start _get_guest_xml network_info=[{"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.objects.instance [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'numa_topology' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.objects.base [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:06:08 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:06:08 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.objects.instance [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'vcpu_model' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.objects.base [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1823636413',display_name='tempest-AttachVolumeTestJSON-server-1823636413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1823636413',id=32,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZNGdZSsfPtAguFJDKN3iVgvVi0aLXdyqROhiDmpQVPMLbPrj6LNqo6zh2eRkFzKq35WCkDJ3pahxf33JmxUgZuGyUraQp1NA3CDVXGmGeP0bYPK2BVWcRuq13QnqVJqg==',key_name='tempest-keypair-1602283704',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:58:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e2d0a8267a0042a0ad831e7b91889dc7',ramdisk_id='',reservation_id='r-2qv66d4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-698620353',owner_user_name='tempest-AttachVolumeTestJSON-698620353-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5711f5c9c8344de79b246e7eb8661ff2',uuid=aef3be9a-fd69-4428-97c3-1016d97ca0e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converting VIF {"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.objects.instance [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'pci_devices' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.objects.base [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:06:08 user nova-compute[72990]:   <uuid>aef3be9a-fd69-4428-97c3-1016d97ca0e9</uuid>
Aug 27 04:06:08 user nova-compute[72990]:   <name>instance-00000020</name>
Aug 27 04:06:08 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:06:08 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:06:08 user nova-compute[72990]:   <metadata>
Aug 27 04:06:08 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:06:08 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:06:08 user nova-compute[72990]:       <nova:name>tempest-AttachVolumeTestJSON-server-1823636413</nova:name>
Aug 27 04:06:08 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:06:08</nova:creationTime>
Aug 27 04:06:08 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:06:08 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:06:08 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:06:08 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:06:08 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:06:08 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:06:08 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:06:08 user nova-compute[72990]:       <nova:owner>
Aug 27 04:06:08 user nova-compute[72990]:         <nova:user uuid="5711f5c9c8344de79b246e7eb8661ff2">tempest-AttachVolumeTestJSON-698620353-project-member</nova:user>
Aug 27 04:06:08 user nova-compute[72990]:         <nova:project uuid="e2d0a8267a0042a0ad831e7b91889dc7">tempest-AttachVolumeTestJSON-698620353</nova:project>
Aug 27 04:06:08 user nova-compute[72990]:       </nova:owner>
Aug 27 04:06:08 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 04:06:08 user nova-compute[72990]:       <nova:ports>
Aug 27 04:06:08 user nova-compute[72990]:         <nova:port uuid="35d5b0ac-308b-4a82-a29d-63bbe0c8ab70">
Aug 27 04:06:08 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 04:06:08 user nova-compute[72990]:         </nova:port>
Aug 27 04:06:08 user nova-compute[72990]:       </nova:ports>
Aug 27 04:06:08 user nova-compute[72990]:     </nova:instance>
Aug 27 04:06:08 user nova-compute[72990]:   </metadata>
Aug 27 04:06:08 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:06:08 user nova-compute[72990]:     <system>
Aug 27 04:06:08 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:06:08 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:06:08 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:06:08 user nova-compute[72990]:       <entry name="serial">aef3be9a-fd69-4428-97c3-1016d97ca0e9</entry>
Aug 27 04:06:08 user nova-compute[72990]:       <entry name="uuid">aef3be9a-fd69-4428-97c3-1016d97ca0e9</entry>
Aug 27 04:06:08 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:06:08 user nova-compute[72990]:     </system>
Aug 27 04:06:08 user nova-compute[72990]:   </sysinfo>
Aug 27 04:06:08 user nova-compute[72990]:   <os>
Aug 27 04:06:08 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:06:08 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:06:08 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:06:08 user nova-compute[72990]:   </os>
Aug 27 04:06:08 user nova-compute[72990]:   <features>
Aug 27 04:06:08 user nova-compute[72990]:     <acpi/>
Aug 27 04:06:08 user nova-compute[72990]:     <apic/>
Aug 27 04:06:08 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:06:08 user nova-compute[72990]:   </features>
Aug 27 04:06:08 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:06:08 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:06:08 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:06:08 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:06:08 user nova-compute[72990]:   </clock>
Aug 27 04:06:08 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:06:08 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:06:08 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:06:08 user nova-compute[72990]:   </cpu>
Aug 27 04:06:08 user nova-compute[72990]:   <devices>
Aug 27 04:06:08 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:06:08 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:06:08 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk"/>
Aug 27 04:06:08 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:06:08 user nova-compute[72990]:     </disk>
Aug 27 04:06:08 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:06:08 user nova-compute[72990]:       <mac address="fa:16:3e:dc:26:ce"/>
Aug 27 04:06:08 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:06:08 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:06:08 user nova-compute[72990]:       <target dev="tap35d5b0ac-30"/>
Aug 27 04:06:08 user nova-compute[72990]:     </interface>
Aug 27 04:06:08 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:06:08 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/console.log" append="off"/>
Aug 27 04:06:08 user nova-compute[72990]:     </serial>
Aug 27 04:06:08 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:06:08 user nova-compute[72990]:     <video>
Aug 27 04:06:08 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:06:08 user nova-compute[72990]:     </video>
Aug 27 04:06:08 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:06:08 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:06:08 user nova-compute[72990]:     </rng>
Aug 27 04:06:08 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:06:08 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:06:08 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:06:08 user nova-compute[72990]:     </memballoon>
Aug 27 04:06:08 user nova-compute[72990]:   </devices>
Aug 27 04:06:08 user nova-compute[72990]: </domain>
Aug 27 04:06:08 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.objects.instance [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'trusted_certs' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.objects.base [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:06:08 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Cannot resize image /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG nova.objects.instance [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'migration_context' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG nova.objects.base [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Object Instance<aef3be9a-fd69-4428-97c3-1016d97ca0e9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72990) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1823636413',display_name='tempest-AttachVolumeTestJSON-server-1823636413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1823636413',id=32,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZNGdZSsfPtAguFJDKN3iVgvVi0aLXdyqROhiDmpQVPMLbPrj6LNqo6zh2eRkFzKq35WCkDJ3pahxf33JmxUgZuGyUraQp1NA3CDVXGmGeP0bYPK2BVWcRuq13QnqVJqg==',key_name='tempest-keypair-1602283704',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:58:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e2d0a8267a0042a0ad831e7b91889dc7',ramdisk_id='',reservation_id='r-2qv66d4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-698620353',owner_user_name='tempest-AttachVolumeTestJSON-698620353-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5711f5c9c8344de79b246e7eb8661ff2',uuid=aef3be9a-fd69-4428-97c3-1016d97ca0e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converting VIF {"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG os_vif [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35d5b0ac-30, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35d5b0ac-30, col_values=(('external_ids', {'iface-id': '35d5b0ac-308b-4a82-a29d-63bbe0c8ab70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:26:ce', 'vm-uuid': 'aef3be9a-fd69-4428-97c3-1016d97ca0e9'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:06:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:09 user nova-compute[72990]: INFO os_vif [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30')
Aug 27 04:06:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-4d841d05-9b70-4fd6-b71e-d0cf309593f6 req-a821e0ce-5042-4a73-8c7b-c08ed634a17c service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:06:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4d841d05-9b70-4fd6-b71e-d0cf309593f6 req-a821e0ce-5042-4a73-8c7b-c08ed634a17c service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4d841d05-9b70-4fd6-b71e-d0cf309593f6 req-a821e0ce-5042-4a73-8c7b-c08ed634a17c service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4d841d05-9b70-4fd6-b71e-d0cf309593f6 req-a821e0ce-5042-4a73-8c7b-c08ed634a17c service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-4d841d05-9b70-4fd6-b71e-d0cf309593f6 req-a821e0ce-5042-4a73-8c7b-c08ed634a17c service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:06:10 user nova-compute[72990]: WARNING nova.compute.manager [req-4d841d05-9b70-4fd6-b71e-d0cf309593f6 req-a821e0ce-5042-4a73-8c7b-c08ed634a17c service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state stopped and task_state powering-on.
Aug 27 04:06:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:12 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109172.71528, aef3be9a-fd69-4428-97c3-1016d97ca0e9 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:06:12 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] VM Resumed (Lifecycle Event)
Aug 27 04:06:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:06:12 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance rebooted successfully.
Aug 27 04:06:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-4fe1e9a8-7e05-4b26-ab36-9dc8342f3533 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:06:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:06:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:06:12 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 27 04:06:12 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109172.7171025, aef3be9a-fd69-4428-97c3-1016d97ca0e9 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:06:12 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] VM Started (Lifecycle Event)
Aug 27 04:06:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:06:12 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:06:12 user nova-compute[72990]: DEBUG nova.compute.manager [req-43354ccd-2057-4a3c-8907-d4891f9822fa req-292d4f06-6d6c-4ac3-be20-6ee5db5c7510 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:06:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-43354ccd-2057-4a3c-8907-d4891f9822fa req-292d4f06-6d6c-4ac3-be20-6ee5db5c7510 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-43354ccd-2057-4a3c-8907-d4891f9822fa req-292d4f06-6d6c-4ac3-be20-6ee5db5c7510 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-43354ccd-2057-4a3c-8907-d4891f9822fa req-292d4f06-6d6c-4ac3-be20-6ee5db5c7510 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:12 user nova-compute[72990]: DEBUG nova.compute.manager [req-43354ccd-2057-4a3c-8907-d4891f9822fa req-292d4f06-6d6c-4ac3-be20-6ee5db5c7510 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:06:12 user nova-compute[72990]: WARNING nova.compute.manager [req-43354ccd-2057-4a3c-8907-d4891f9822fa req-292d4f06-6d6c-4ac3-be20-6ee5db5c7510 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state active and task_state None.
Aug 27 04:06:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-ab47072d-9e13-4148-9827-86b38cbca79b req-5fe4e629-1a25-4e54-a614-cf6db8ab8d24 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Received event network-changed-3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:06:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-ab47072d-9e13-4148-9827-86b38cbca79b req-5fe4e629-1a25-4e54-a614-cf6db8ab8d24 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Refreshing instance network info cache due to event network-changed-3b75e34d-7706-4188-9324-0d985e1994a8. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:06:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ab47072d-9e13-4148-9827-86b38cbca79b req-5fe4e629-1a25-4e54-a614-cf6db8ab8d24 service nova] Acquiring lock "refresh_cache-861db154-c722-4164-a1eb-5f0bee266356" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:06:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ab47072d-9e13-4148-9827-86b38cbca79b req-5fe4e629-1a25-4e54-a614-cf6db8ab8d24 service nova] Acquired lock "refresh_cache-861db154-c722-4164-a1eb-5f0bee266356" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:06:28 user nova-compute[72990]: DEBUG nova.network.neutron [req-ab47072d-9e13-4148-9827-86b38cbca79b req-5fe4e629-1a25-4e54-a614-cf6db8ab8d24 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Refreshing network info cache for port 3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:06:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "861db154-c722-4164-a1eb-5f0bee266356" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "861db154-c722-4164-a1eb-5f0bee266356" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:28 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lazy-loading 'flavor' on Instance uuid 861db154-c722-4164-a1eb-5f0bee266356 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:06:28 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Ignoring supplied device name: /dev/vdb
Aug 27 04:06:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "861db154-c722-4164-a1eb-5f0bee266356" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "861db154-c722-4164-a1eb-5f0bee266356" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "861db154-c722-4164-a1eb-5f0bee266356" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:29 user nova-compute[72990]: INFO nova.compute.manager [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Attaching volume ce680ec4-616b-4119-be7f-b16b06dea883 to /dev/vdb
Aug 27 04:06:29 user nova-compute[72990]: DEBUG nova.network.neutron [req-ab47072d-9e13-4148-9827-86b38cbca79b req-5fe4e629-1a25-4e54-a614-cf6db8ab8d24 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Updated VIF entry in instance network info cache for port 3b75e34d-7706-4188-9324-0d985e1994a8. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG nova.network.neutron [req-ab47072d-9e13-4148-9827-86b38cbca79b req-5fe4e629-1a25-4e54-a614-cf6db8ab8d24 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Updating instance_info_cache with network_info: [{"id": "3b75e34d-7706-4188-9324-0d985e1994a8", "address": "fa:16:3e:df:31:d3", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b75e34d-77", "ovs_interfaceid": "3b75e34d-7706-4188-9324-0d985e1994a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ab47072d-9e13-4148-9827-86b38cbca79b req-5fe4e629-1a25-4e54-a614-cf6db8ab8d24 service nova] Releasing lock "refresh_cache-861db154-c722-4164-a1eb-5f0bee266356" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG os_brick.utils [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3692625-77ed-4146-83d6-2f38a98becdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef68fd98-d155-4d78-a187-a915e4ba478a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ad82cf-33ec-4e78-bb87-0ad32ee629a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[33871ac0-929b-4711-897c-8bd1159d9fa9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:06:29 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:06:29 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c474548-4c80-4291-8e95-3a9484c153e9]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG os_brick.utils [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:06:29 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Updating existing volume attachment record: 9397ed49-c8ee-4911-b710-09fd8ae9915c {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:06:31 user nova-compute[72990]: DEBUG nova.compute.manager [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:06:31 user nova-compute[72990]: INFO nova.compute.manager [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] instance snapshotting
Aug 27 04:06:31 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Beginning live snapshot process
Aug 27 04:06:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json -f qcow2 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:31 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json -f qcow2 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmm4le8q9/306ce8da774642debc49087085182daa.delta 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:32 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmm4le8q9/306ce8da774642debc49087085182daa.delta 1073741824" returned: 0 in 0.055s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:32 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 04:06:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 04:06:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72990) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 04:06:33 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 04:06:33 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 04:06:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmm4le8q9/306ce8da774642debc49087085182daa.delta /opt/stack/data/nova/instances/snapshots/tmpmm4le8q9/306ce8da774642debc49087085182daa {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:34 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmm4le8q9/306ce8da774642debc49087085182daa.delta /opt/stack/data/nova/instances/snapshots/tmpmm4le8q9/306ce8da774642debc49087085182daa" returned: 0 in 0.615s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:34 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Snapshot extracted, beginning image upload
Aug 27 04:06:34 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:06:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 04:06:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] There are 0 instances to clean {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 04:06:36 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Snapshot image upload complete
Aug 27 04:06:36 user nova-compute[72990]: INFO nova.compute.manager [None req-cd970485-d183-4ef9-8e49-badbdaa06651 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Took 5.54 seconds to snapshot the instance on the hypervisor.
Aug 27 04:06:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:38 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:06:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:06:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:39 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:06:39 user nova-compute[72990]: INFO nova.compute.claims [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Claim successful on node user
Aug 27 04:06:39 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:06:39 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:06:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:06:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:06:40 user nova-compute[72990]: DEBUG nova.network.neutron [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:06:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:06:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:06:40 user nova-compute[72990]: DEBUG nova.policy [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed6cd92bb0204e2f9afb35f8d9d2243b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34fab9761d749e09b47e567fa51a7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:06:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:06:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:06:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Creating image(s)
Aug 27 04:06:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "/opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "/opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "/opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "bf62bf788ed6f3aaf5163092c981344d6f55a70a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "bf62bf788ed6f3aaf5163092c981344d6f55a70a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a.part --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Successfully created port: 3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a.part --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG nova.virt.images [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] 5f4b77a3-44e2-478f-b34d-4e7f4bf80c40 was qcow2, converting to raw {{(pid=72990) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a.part /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a.converted {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a.part /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a.converted" returned: 0 in 0.457s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a.converted --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KIMXcfZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:06:41 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:06:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:06:41 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:06:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:06:41 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c76236e-b0d7-42c2-b784-3a41a965eb9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:06:41 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03f0488-38ae-458a-851a-dea02329278e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883] added
Aug 27 04:06:41 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe45b66-25b0-47c7-b9db-ba26db9cbe10]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa92c6c-68e0-4196-977a-5a5fb5ca816e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KIMXcfZE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "bf62bf788ed6f3aaf5163092c981344d6f55a70a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.778s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KIMXcfZE" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5cc4c5-9556-4e38-8893-e3ac0f6e334b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KIMXcfZE'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22e1c5a-1b26-491c-8907-a12185d8cd0b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[96011a64-3e78-47af-a5b8-f1ce026df326]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:06:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:06:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Successfully updated port: 3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[73802f96-4972-4588-bad3-c22b54b849d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883, portal: 172.16.0.220,3260]
Aug 27 04:06:42 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883, portal: 172.16.0.220,3260] successful.
Aug 27 04:06:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "bf62bf788ed6f3aaf5163092c981344d6f55a70a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "bf62bf788ed6f3aaf5163092c981344d6f55a70a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc5ddb9-0cae-4548-92aa-a3abec1724f0]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "refresh_cache-83ea4f5e-3381-4561-8bdb-868466b4d49d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquired lock "refresh_cache-83ea4f5e-3381-4561-8bdb-868466b4d49d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[664303d0-50bb-446a-8058-420d81078faa]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:06:42 user nova-compute[72990]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 (non-flash)
Aug 27 04:06:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:06:42 user nova-compute[72990]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 (non-flash)
Aug 27 04:06:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b94df8-7efd-4da2-bb5a-141d55e37f99]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KIMXcfZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-df826933-f918-4d56-aadf-6b6f9626b710 req-46d07299-f9c4-4ec5-87b9-0375f6b43894 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Received event network-changed-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-df826933-f918-4d56-aadf-6b6f9626b710 req-46d07299-f9c4-4ec5-87b9-0375f6b43894 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Refreshing instance network info cache due to event network-changed-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-df826933-f918-4d56-aadf-6b6f9626b710 req-46d07299-f9c4-4ec5-87b9-0375f6b43894 service nova] Acquiring lock "refresh_cache-83ea4f5e-3381-4561-8bdb-868466b4d49d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a,backing_fmt=raw /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a,backing_fmt=raw /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk 1073741824" returned: 0 in 0.062s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "bf62bf788ed6f3aaf5163092c981344d6f55a70a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Ensure instance console log exists: /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Updating instance_info_cache with network_info: [{"id": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "address": "fa:16:3e:79:f3:1f", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3a4f8d-49", "ovs_interfaceid": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Releasing lock "refresh_cache-83ea4f5e-3381-4561-8bdb-868466b4d49d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Instance network_info: |[{"id": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "address": "fa:16:3e:79:f3:1f", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3a4f8d-49", "ovs_interfaceid": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-df826933-f918-4d56-aadf-6b6f9626b710 req-46d07299-f9c4-4ec5-87b9-0375f6b43894 service nova] Acquired lock "refresh_cache-83ea4f5e-3381-4561-8bdb-868466b4d49d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.network.neutron [req-df826933-f918-4d56-aadf-6b6f9626b710 req-46d07299-f9c4-4ec5-87b9-0375f6b43894 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Refreshing network info cache for port 3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Start _get_guest_xml network_info=[{"id": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "address": "fa:16:3e:79:f3:1f", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3a4f8d-49", "ovs_interfaceid": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='679d44ab98f600d2a49c8bca31349e8c',container_format='bare',created_at=2023-08-27T04:06:31Z,direct_url=<?>,disk_format='qcow2',id=5f4b77a3-44e2-478f-b34d-4e7f4bf80c40,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2145850180',owner='e34fab9761d749e09b47e567fa51a7fb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T04:06:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': '5f4b77a3-44e2-478f-b34d-4e7f4bf80c40'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:06:42 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:06:42 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='679d44ab98f600d2a49c8bca31349e8c',container_format='bare',created_at=2023-08-27T04:06:31Z,direct_url=<?>,disk_format='qcow2',id=5f4b77a3-44e2-478f-b34d-4e7f4bf80c40,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2145850180',owner='e34fab9761d749e09b47e567fa51a7fb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T04:06:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:06:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1325838409',display_name='tempest-TestStampPattern-server-1325838409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1325838409',id=42,image_ref='5f4b77a3-44e2-478f-b34d-4e7f4bf80c40',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLnR311AGfUBQnoCXVcWBj+0ahQsHJMZMsICHM9pMdM0SqwxaZxX2k42Vtz1wur5D7C2c2Z+aWIY4GEPKcd/XyikzDfg8PQJ3qOnMiQdQiAFgolbW2xxY+fNS+9ERDXhw==',key_name='tempest-TestStampPattern-1905683854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e34fab9761d749e09b47e567fa51a7fb',ramdisk_id='',reservation_id='r-0c99riq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='da3f86d1-09e4-4c85-b275-145c86f1aa15',image_min_disk='1',image_min_ram='0',image_owner_id='e34fab9761d749e09b47e567fa51a7fb',image_owner_project_name='tempest-TestStampPattern-1496658836',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1496658836-project-member',image_user_id='ed6cd92bb0204e2f9afb35f8d9d2243b',network_allocated='True',owner_project_name='tempest-TestStampPattern-1496658836',owner_user_name='tempest-TestStampPattern-1496658836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:06:40Z,user_data=None,user_id='ed6cd92bb0204e2f9afb35f8d9d2243b',uuid=83ea4f5e-3381-4561-8bdb-868466b4d49d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "address": "fa:16:3e:79:f3:1f", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3a4f8d-49", "ovs_interfaceid": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Converting VIF {"id": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "address": "fa:16:3e:79:f3:1f", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3a4f8d-49", "ovs_interfaceid": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3a4f8d-49') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.objects.instance [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lazy-loading 'pci_devices' on Instance uuid 83ea4f5e-3381-4561-8bdb-868466b4d49d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:06:42 user nova-compute[72990]:   <uuid>83ea4f5e-3381-4561-8bdb-868466b4d49d</uuid>
Aug 27 04:06:42 user nova-compute[72990]:   <name>instance-0000002a</name>
Aug 27 04:06:42 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:06:42 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:06:42 user nova-compute[72990]:   <metadata>
Aug 27 04:06:42 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:06:42 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:06:42 user nova-compute[72990]:       <nova:name>tempest-TestStampPattern-server-1325838409</nova:name>
Aug 27 04:06:42 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:06:42</nova:creationTime>
Aug 27 04:06:42 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:06:42 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:06:42 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:06:42 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:06:42 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:06:42 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:06:42 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:06:42 user nova-compute[72990]:       <nova:owner>
Aug 27 04:06:42 user nova-compute[72990]:         <nova:user uuid="ed6cd92bb0204e2f9afb35f8d9d2243b">tempest-TestStampPattern-1496658836-project-member</nova:user>
Aug 27 04:06:42 user nova-compute[72990]:         <nova:project uuid="e34fab9761d749e09b47e567fa51a7fb">tempest-TestStampPattern-1496658836</nova:project>
Aug 27 04:06:42 user nova-compute[72990]:       </nova:owner>
Aug 27 04:06:42 user nova-compute[72990]:       <nova:root type="image" uuid="5f4b77a3-44e2-478f-b34d-4e7f4bf80c40"/>
Aug 27 04:06:42 user nova-compute[72990]:       <nova:ports>
Aug 27 04:06:42 user nova-compute[72990]:         <nova:port uuid="3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51">
Aug 27 04:06:42 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 04:06:42 user nova-compute[72990]:         </nova:port>
Aug 27 04:06:42 user nova-compute[72990]:       </nova:ports>
Aug 27 04:06:42 user nova-compute[72990]:     </nova:instance>
Aug 27 04:06:42 user nova-compute[72990]:   </metadata>
Aug 27 04:06:42 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:06:42 user nova-compute[72990]:     <system>
Aug 27 04:06:42 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:06:42 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:06:42 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:06:42 user nova-compute[72990]:       <entry name="serial">83ea4f5e-3381-4561-8bdb-868466b4d49d</entry>
Aug 27 04:06:42 user nova-compute[72990]:       <entry name="uuid">83ea4f5e-3381-4561-8bdb-868466b4d49d</entry>
Aug 27 04:06:42 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:06:42 user nova-compute[72990]:     </system>
Aug 27 04:06:42 user nova-compute[72990]:   </sysinfo>
Aug 27 04:06:42 user nova-compute[72990]:   <os>
Aug 27 04:06:42 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:06:42 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:06:42 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:06:42 user nova-compute[72990]:   </os>
Aug 27 04:06:42 user nova-compute[72990]:   <features>
Aug 27 04:06:42 user nova-compute[72990]:     <acpi/>
Aug 27 04:06:42 user nova-compute[72990]:     <apic/>
Aug 27 04:06:42 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:06:42 user nova-compute[72990]:   </features>
Aug 27 04:06:42 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:06:42 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:06:42 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:06:42 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:06:42 user nova-compute[72990]:   </clock>
Aug 27 04:06:42 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:06:42 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:06:42 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:06:42 user nova-compute[72990]:   </cpu>
Aug 27 04:06:42 user nova-compute[72990]:   <devices>
Aug 27 04:06:42 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:06:42 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:06:42 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk"/>
Aug 27 04:06:42 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:06:42 user nova-compute[72990]:     </disk>
Aug 27 04:06:42 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:06:42 user nova-compute[72990]:       <mac address="fa:16:3e:79:f3:1f"/>
Aug 27 04:06:42 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:06:42 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:06:42 user nova-compute[72990]:       <target dev="tap3a3a4f8d-49"/>
Aug 27 04:06:42 user nova-compute[72990]:     </interface>
Aug 27 04:06:42 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:06:42 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/console.log" append="off"/>
Aug 27 04:06:42 user nova-compute[72990]:     </serial>
Aug 27 04:06:42 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:06:42 user nova-compute[72990]:     <video>
Aug 27 04:06:42 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:06:42 user nova-compute[72990]:     </video>
Aug 27 04:06:42 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:06:42 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:06:42 user nova-compute[72990]:     </rng>
Aug 27 04:06:42 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:06:42 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:06:42 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:06:42 user nova-compute[72990]:     </memballoon>
Aug 27 04:06:42 user nova-compute[72990]:   </devices>
Aug 27 04:06:42 user nova-compute[72990]: </domain>
Aug 27 04:06:42 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:06:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1325838409',display_name='tempest-TestStampPattern-server-1325838409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1325838409',id=42,image_ref='5f4b77a3-44e2-478f-b34d-4e7f4bf80c40',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLnR311AGfUBQnoCXVcWBj+0ahQsHJMZMsICHM9pMdM0SqwxaZxX2k42Vtz1wur5D7C2c2Z+aWIY4GEPKcd/XyikzDfg8PQJ3qOnMiQdQiAFgolbW2xxY+fNS+9ERDXhw==',key_name='tempest-TestStampPattern-1905683854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e34fab9761d749e09b47e567fa51a7fb',ramdisk_id='',reservation_id='r-0c99riq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='da3f86d1-09e4-4c85-b275-145c86f1aa15',image_min_disk='1',image_min_ram='0',image_owner_id='e34fab9761d749e09b47e567fa51a7fb',image_owner_project_name='tempest-TestStampPattern-1496658836',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1496658836-project-member',image_user_id='ed6cd92bb0204e2f9afb35f8d9d2243b',network_allocated='True',owner_project_name='tempest-TestStampPattern-1496658836',owner_user_name='tempest-TestStampPattern-1496658836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:06:40Z,user_data=None,user_id='ed6cd92bb0204e2f9afb35f8d9d2243b',uuid=83ea4f5e-3381-4561-8bdb-868466b4d49d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "address": "fa:16:3e:79:f3:1f", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3a4f8d-49", "ovs_interfaceid": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Converting VIF {"id": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "address": "fa:16:3e:79:f3:1f", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3a4f8d-49", "ovs_interfaceid": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3a4f8d-49') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG os_vif [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3a4f8d-49') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a3a4f8d-49, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a3a4f8d-49, col_values=(('external_ids', {'iface-id': '3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:f3:1f', 'vm-uuid': '83ea4f5e-3381-4561-8bdb-868466b4d49d'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:42 user nova-compute[72990]: INFO os_vif [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3a4f8d-49')
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:06:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] No VIF found with MAC fa:16:3e:79:f3:1f, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:06:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:43 user nova-compute[72990]: DEBUG nova.network.neutron [req-df826933-f918-4d56-aadf-6b6f9626b710 req-46d07299-f9c4-4ec5-87b9-0375f6b43894 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Updated VIF entry in instance network info cache for port 3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:06:43 user nova-compute[72990]: DEBUG nova.network.neutron [req-df826933-f918-4d56-aadf-6b6f9626b710 req-46d07299-f9c4-4ec5-87b9-0375f6b43894 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Updating instance_info_cache with network_info: [{"id": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "address": "fa:16:3e:79:f3:1f", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3a4f8d-49", "ovs_interfaceid": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:06:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-df826933-f918-4d56-aadf-6b6f9626b710 req-46d07299-f9c4-4ec5-87b9-0375f6b43894 service nova] Releasing lock "refresh_cache-83ea4f5e-3381-4561-8bdb-868466b4d49d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:06:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:06:43 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '23631346162363262', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:06:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631346162363262', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:06:43 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lazy-loading 'flavor' on Instance uuid 861db154-c722-4164-a1eb-5f0bee266356 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:06:43 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:06:43 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:06:43 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 04:06:43 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:06:43 user nova-compute[72990]:   <serial>ce680ec4-616b-4119-be7f-b16b06dea883</serial>
Aug 27 04:06:43 user nova-compute[72990]: </disk>
Aug 27 04:06:43 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] No VIF found with MAC fa:16:3e:df:31:d3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9c597c60-274a-4528-a4d9-123d48e600d4 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "861db154-c722-4164-a1eb-5f0bee266356" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.043s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-995bafdd-36f3-4008-8c37-ff1908354307 req-b02fdbde-180c-41a3-91b6-522b7b05c8c3 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Received event network-vif-plugged-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-995bafdd-36f3-4008-8c37-ff1908354307 req-b02fdbde-180c-41a3-91b6-522b7b05c8c3 service nova] Acquiring lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-995bafdd-36f3-4008-8c37-ff1908354307 req-b02fdbde-180c-41a3-91b6-522b7b05c8c3 service nova] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-995bafdd-36f3-4008-8c37-ff1908354307 req-b02fdbde-180c-41a3-91b6-522b7b05c8c3 service nova] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-995bafdd-36f3-4008-8c37-ff1908354307 req-b02fdbde-180c-41a3-91b6-522b7b05c8c3 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] No waiting events found dispatching network-vif-plugged-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:06:44 user nova-compute[72990]: WARNING nova.compute.manager [req-995bafdd-36f3-4008-8c37-ff1908354307 req-b02fdbde-180c-41a3-91b6-522b7b05c8c3 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Received unexpected event network-vif-plugged-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 for instance with vm_state building and task_state spawning.
Aug 27 04:06:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109206.8710554, 83ea4f5e-3381-4561-8bdb-868466b4d49d => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:06:46 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] VM Resumed (Lifecycle Event)
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:06:46 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Instance spawned successfully.
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:06:46 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109206.8765202, 83ea4f5e-3381-4561-8bdb-868466b4d49d => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:06:46 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] VM Started (Lifecycle Event)
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-6d992f5d-8750-4233-ae7d-0bbdebece7e2 req-9cd19aa9-d2ed-4428-9350-be701c142f5e service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Received event network-vif-plugged-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6d992f5d-8750-4233-ae7d-0bbdebece7e2 req-9cd19aa9-d2ed-4428-9350-be701c142f5e service nova] Acquiring lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6d992f5d-8750-4233-ae7d-0bbdebece7e2 req-9cd19aa9-d2ed-4428-9350-be701c142f5e service nova] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6d992f5d-8750-4233-ae7d-0bbdebece7e2 req-9cd19aa9-d2ed-4428-9350-be701c142f5e service nova] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-6d992f5d-8750-4233-ae7d-0bbdebece7e2 req-9cd19aa9-d2ed-4428-9350-be701c142f5e service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] No waiting events found dispatching network-vif-plugged-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:06:46 user nova-compute[72990]: WARNING nova.compute.manager [req-6d992f5d-8750-4233-ae7d-0bbdebece7e2 req-9cd19aa9-d2ed-4428-9350-be701c142f5e service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Received unexpected event network-vif-plugged-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 for instance with vm_state building and task_state spawning.
Aug 27 04:06:46 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:06:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:06:47 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:06:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:47 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:06:47 user nova-compute[72990]: INFO nova.compute.manager [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Took 6.81 seconds to spawn the instance on the hypervisor.
Aug 27 04:06:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:06:47 user nova-compute[72990]: INFO nova.compute.manager [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Took 7.74 seconds to build instance.
Aug 27 04:06:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3802a3aa-19ae-4fb0-a71f-0b0a9bb77f6c tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.840s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:06:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:06:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:06:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:06:50 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:06:50 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7824MB free_disk=24.96319580078125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance ae9e24d9-20e5-4642-b6d3-de298c138730 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance da3f86d1-09e4-4c85-b275-145c86f1aa15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 861db154-c722-4164-a1eb-5f0bee266356 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 0206498e-6ec9-4af7-a4bb-ea512b71e4be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 83ea4f5e-3381-4561-8bdb-868466b4d49d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing inventories for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating ProviderTree inventory for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating inventory in ProviderTree for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing aggregate associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, aggregates: None {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing trait associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:06:50 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:06:51 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:06:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.776s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:06:51 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:06:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:06:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:06:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:06:51 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:06:52 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updating instance_info_cache with network_info: [{"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:06:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:06:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:06:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:06:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:06:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:06:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:06:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:06:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72990) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid ae9e24d9-20e5-4642-b6d3-de298c138730 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid da3f86d1-09e4-4c85-b275-145c86f1aa15 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 861db154-c722-4164-a1eb-5f0bee266356 {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 0206498e-6ec9-4af7-a4bb-ea512b71e4be {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 83ea4f5e-3381-4561-8bdb-868466b4d49d {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "ae9e24d9-20e5-4642-b6d3-de298c138730" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "861db154-c722-4164-a1eb-5f0bee266356" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "861db154-c722-4164-a1eb-5f0bee266356" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "861db154-c722-4164-a1eb-5f0bee266356" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG nova.compute.manager [req-e33d99e0-f53c-444c-a521-1c18b8bccd73 req-84988699-beec-4df7-825e-64ab130fd82b service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Received event network-changed-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG nova.compute.manager [req-e33d99e0-f53c-444c-a521-1c18b8bccd73 req-84988699-beec-4df7-825e-64ab130fd82b service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Refreshing instance network info cache due to event network-changed-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e33d99e0-f53c-444c-a521-1c18b8bccd73 req-84988699-beec-4df7-825e-64ab130fd82b service nova] Acquiring lock "refresh_cache-0206498e-6ec9-4af7-a4bb-ea512b71e4be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e33d99e0-f53c-444c-a521-1c18b8bccd73 req-84988699-beec-4df7-825e-64ab130fd82b service nova] Acquired lock "refresh_cache-0206498e-6ec9-4af7-a4bb-ea512b71e4be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG nova.network.neutron [req-e33d99e0-f53c-444c-a521-1c18b8bccd73 req-84988699-beec-4df7-825e-64ab130fd82b service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Refreshing network info cache for port 1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG nova.network.neutron [req-e33d99e0-f53c-444c-a521-1c18b8bccd73 req-84988699-beec-4df7-825e-64ab130fd82b service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Updated VIF entry in instance network info cache for port 1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG nova.network.neutron [req-e33d99e0-f53c-444c-a521-1c18b8bccd73 req-84988699-beec-4df7-825e-64ab130fd82b service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Updating instance_info_cache with network_info: [{"id": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "address": "fa:16:3e:d1:9d:84", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1563d87c-b7", "ovs_interfaceid": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-e33d99e0-f53c-444c-a521-1c18b8bccd73 req-84988699-beec-4df7-825e-64ab130fd82b service nova] Releasing lock "refresh_cache-0206498e-6ec9-4af7-a4bb-ea512b71e4be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "ae9e24d9-20e5-4642-b6d3-de298c138730" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:24 user nova-compute[72990]: INFO nova.compute.manager [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Terminating instance
Aug 27 04:07:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:07:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-86e5d43e-0325-494d-b1df-d635294e7702 req-38c413ea-afcc-49f7-b14a-0b2929a8d953 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Received event network-vif-unplugged-30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-86e5d43e-0325-494d-b1df-d635294e7702 req-38c413ea-afcc-49f7-b14a-0b2929a8d953 service nova] Acquiring lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-86e5d43e-0325-494d-b1df-d635294e7702 req-38c413ea-afcc-49f7-b14a-0b2929a8d953 service nova] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-86e5d43e-0325-494d-b1df-d635294e7702 req-38c413ea-afcc-49f7-b14a-0b2929a8d953 service nova] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-86e5d43e-0325-494d-b1df-d635294e7702 req-38c413ea-afcc-49f7-b14a-0b2929a8d953 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] No waiting events found dispatching network-vif-unplugged-30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-86e5d43e-0325-494d-b1df-d635294e7702 req-38c413ea-afcc-49f7-b14a-0b2929a8d953 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Received event network-vif-unplugged-30a7414a-b255-445a-bb41-1f2a6ab29b2b for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:07:25 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Instance destroyed successfully.
Aug 27 04:07:25 user nova-compute[72990]: DEBUG nova.objects.instance [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lazy-loading 'resources' on Instance uuid ae9e24d9-20e5-4642-b6d3-de298c138730 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-711638539',display_name='tempest-TestMinimumBasicScenario-server-711638539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-711638539',id=37,image_ref='495f4987-808e-4ba5-8d44-dad50c10e7a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxV9PIrZjpEjdaxZySrTj6+PXP0vwjtq61bBsDfK+SqYBGoC/25IJQhmR+2t1qRQJBqTXIbnMyvoKnElXpMQyZWmtnGGgX8JpudRt+7wCoythdqpVrCfP38n8oWU5eunw==',key_name='tempest-TestMinimumBasicScenario-2082822136',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:02:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b2eb083c82b4dfcbad70f865367a84a',ramdisk_id='',reservation_id='r-fpcnh9i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='495f4987-808e-4ba5-8d44-dad50c10e7a1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1213348251',owner_user_name='tempest-TestMinimumBasicScenario-1213348251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:02:13Z,user_data=None,user_id='8a2bca29600d4e3e8915894716b24bdc',uuid=ae9e24d9-20e5-4642-b6d3-de298c138730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "address": "fa:16:3e:8b:f2:b3", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a7414a-b2", "ovs_interfaceid": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Converting VIF {"id": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "address": "fa:16:3e:8b:f2:b3", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a7414a-b2", "ovs_interfaceid": "30a7414a-b255-445a-bb41-1f2a6ab29b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f2:b3,bridge_name='br-int',has_traffic_filtering=True,id=30a7414a-b255-445a-bb41-1f2a6ab29b2b,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a7414a-b2') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG os_vif [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f2:b3,bridge_name='br-int',has_traffic_filtering=True,id=30a7414a-b255-445a-bb41-1f2a6ab29b2b,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a7414a-b2') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30a7414a-b2, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:07:25 user nova-compute[72990]: INFO os_vif [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f2:b3,bridge_name='br-int',has_traffic_filtering=True,id=30a7414a-b255-445a-bb41-1f2a6ab29b2b,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a7414a-b2')
Aug 27 04:07:25 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Deleting instance files /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730_del
Aug 27 04:07:25 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Deletion of /opt/stack/data/nova/instances/ae9e24d9-20e5-4642-b6d3-de298c138730_del complete
Aug 27 04:07:25 user nova-compute[72990]: INFO nova.compute.manager [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 27 04:07:25 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:07:25 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:07:26 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:07:26 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Took 0.64 seconds to deallocate network for instance.
Aug 27 04:07:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:26 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:07:26 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:07:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:26 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Deleted allocations for instance ae9e24d9-20e5-4642-b6d3-de298c138730
Aug 27 04:07:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-40e72831-3614-4aa3-b948-0dfe5a10d2dd tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.234s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-063ef399-12ee-4bb4-85f7-b04b2674550b req-2741fada-0c08-494d-8b2c-4f17806a1465 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Received event network-vif-plugged-30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:07:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063ef399-12ee-4bb4-85f7-b04b2674550b req-2741fada-0c08-494d-8b2c-4f17806a1465 service nova] Acquiring lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063ef399-12ee-4bb4-85f7-b04b2674550b req-2741fada-0c08-494d-8b2c-4f17806a1465 service nova] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-063ef399-12ee-4bb4-85f7-b04b2674550b req-2741fada-0c08-494d-8b2c-4f17806a1465 service nova] Lock "ae9e24d9-20e5-4642-b6d3-de298c138730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-063ef399-12ee-4bb4-85f7-b04b2674550b req-2741fada-0c08-494d-8b2c-4f17806a1465 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] No waiting events found dispatching network-vif-plugged-30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:07:27 user nova-compute[72990]: WARNING nova.compute.manager [req-063ef399-12ee-4bb4-85f7-b04b2674550b req-2741fada-0c08-494d-8b2c-4f17806a1465 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Received unexpected event network-vif-plugged-30a7414a-b255-445a-bb41-1f2a6ab29b2b for instance with vm_state deleted and task_state None.
Aug 27 04:07:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-063ef399-12ee-4bb4-85f7-b04b2674550b req-2741fada-0c08-494d-8b2c-4f17806a1465 service nova] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Received event network-vif-deleted-30a7414a-b255-445a-bb41-1f2a6ab29b2b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:07:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "861db154-c722-4164-a1eb-5f0bee266356" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "861db154-c722-4164-a1eb-5f0bee266356" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:38 user nova-compute[72990]: INFO nova.compute.manager [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Detaching volume ce680ec4-616b-4119-be7f-b16b06dea883
Aug 27 04:07:38 user nova-compute[72990]: INFO nova.virt.block_device [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Attempting to driver detach volume ce680ec4-616b-4119-be7f-b16b06dea883 from mountpoint /dev/vdb
Aug 27 04:07:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Attempting to detach device vdb from instance 861db154-c722-4164-a1eb-5f0bee266356 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:07:38 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:07:38 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 04:07:38 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:07:38 user nova-compute[72990]:   <serial>ce680ec4-616b-4119-be7f-b16b06dea883</serial>
Aug 27 04:07:38 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:07:38 user nova-compute[72990]: </disk>
Aug 27 04:07:38 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:07:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Successfully detached device vdb from instance 861db154-c722-4164-a1eb-5f0bee266356 from the persistent domain config.
Aug 27 04:07:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 861db154-c722-4164-a1eb-5f0bee266356 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:07:38 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:07:38 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 04:07:38 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:07:38 user nova-compute[72990]:   <serial>ce680ec4-616b-4119-be7f-b16b06dea883</serial>
Aug 27 04:07:38 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:07:38 user nova-compute[72990]: </disk>
Aug 27 04:07:38 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "861db154-c722-4164-a1eb-5f0bee266356" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693109258.9374182, 861db154-c722-4164-a1eb-5f0bee266356 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 861db154-c722-4164-a1eb-5f0bee266356 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:07:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Successfully detached device vdb from instance 861db154-c722-4164-a1eb-5f0bee266356 from the live domain config.
Aug 27 04:07:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KIMXcfZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:07:38 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:07:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fee13a7-1a78-4ae1-abf2-d456fa6a83a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eab5c59-ab24-4f24-a0cf-aa74f78c04f0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:07:39 user nova-compute[72990]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 (non-flash)
Aug 27 04:07:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:07:39 user nova-compute[72990]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 (non-flash)
Aug 27 04:07:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f416bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cbdebc-4511-4fad-86a9-ce10c220e58e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23c1f4f-efc2-4ab1-9b7c-c950ee0bc648]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9633a773-1e76-49d3-ab13-ce127b59535e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd76691-8290-434e-917d-597e21b03feb]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e918ed5-6db7-4bf8-b6f2-11fe9419cac7]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c081a5b2-e0ad-406d-91e4-7bb75854bfe7]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883, portal: 172.16.0.220,3260]
Aug 27 04:07:39 user nova-compute[72990]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883, portal: 172.16.0.220,3260] successful.
Aug 27 04:07:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fcb76a-6602-4a2d-a83b-d94ed37f7cb7]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] <== disconnect_volume: return (257ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:07:39 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.objects.instance [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lazy-loading 'flavor' on Instance uuid 861db154-c722-4164-a1eb-5f0bee266356 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-5035a3ae-6905-4ede-a8d7-57dc94e33eb2 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "861db154-c722-4164-a1eb-5f0bee266356" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.753s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "861db154-c722-4164-a1eb-5f0bee266356" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.621s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "861db154-c722-4164-a1eb-5f0bee266356-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "861db154-c722-4164-a1eb-5f0bee266356-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "861db154-c722-4164-a1eb-5f0bee266356-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:40 user nova-compute[72990]: INFO nova.compute.manager [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Terminating instance
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-5aee3fc8-22f8-418c-a1a2-97473848ecf3 req-96295d34-9cf8-4413-9f19-3cf63f100489 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Received event network-vif-unplugged-3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5aee3fc8-22f8-418c-a1a2-97473848ecf3 req-96295d34-9cf8-4413-9f19-3cf63f100489 service nova] Acquiring lock "861db154-c722-4164-a1eb-5f0bee266356-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5aee3fc8-22f8-418c-a1a2-97473848ecf3 req-96295d34-9cf8-4413-9f19-3cf63f100489 service nova] Lock "861db154-c722-4164-a1eb-5f0bee266356-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5aee3fc8-22f8-418c-a1a2-97473848ecf3 req-96295d34-9cf8-4413-9f19-3cf63f100489 service nova] Lock "861db154-c722-4164-a1eb-5f0bee266356-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-5aee3fc8-22f8-418c-a1a2-97473848ecf3 req-96295d34-9cf8-4413-9f19-3cf63f100489 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] No waiting events found dispatching network-vif-unplugged-3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-5aee3fc8-22f8-418c-a1a2-97473848ecf3 req-96295d34-9cf8-4413-9f19-3cf63f100489 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Received event network-vif-unplugged-3b75e34d-7706-4188-9324-0d985e1994a8 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109245.6614892, ae9e24d9-20e5-4642-b6d3-de298c138730 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:07:40 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] VM Stopped (Lifecycle Event)
Aug 27 04:07:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.compute.manager [None req-470157fa-d198-41b3-aa0f-b1bcc94397f1 None None] [instance: ae9e24d9-20e5-4642-b6d3-de298c138730] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Instance destroyed successfully.
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.objects.instance [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lazy-loading 'resources' on Instance uuid 861db154-c722-4164-a1eb-5f0bee266356 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1593562022',display_name='tempest-VolumesSnapshotTestJSON-instance-1593562022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1593562022',id=40,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb3QPelBWNfoD5QbxYe2LVgVztGeidW+sVuQyTZ8ajc41/U9irqNI3feV1VhUZB0PDPTdkjgxieGPSJ45wxjvh0DaBRfy2PS7VxR0cBVi28qJzwoGrReqDH749D38MKtg==',key_name='tempest-keypair-42088266',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:04:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='672e3e9fbb0844ada56ef6b665212fb0',ramdisk_id='',reservation_id='r-x8m0sdlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1409906536',owner_user_name='tempest-VolumesSnapshotTestJSON-1409906536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bc7642afe894fea911c5bd6250e436f',uuid=861db154-c722-4164-a1eb-5f0bee266356,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b75e34d-7706-4188-9324-0d985e1994a8", "address": "fa:16:3e:df:31:d3", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b75e34d-77", "ovs_interfaceid": "3b75e34d-7706-4188-9324-0d985e1994a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Converting VIF {"id": "3b75e34d-7706-4188-9324-0d985e1994a8", "address": "fa:16:3e:df:31:d3", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b75e34d-77", "ovs_interfaceid": "3b75e34d-7706-4188-9324-0d985e1994a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:31:d3,bridge_name='br-int',has_traffic_filtering=True,id=3b75e34d-7706-4188-9324-0d985e1994a8,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b75e34d-77') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG os_vif [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:31:d3,bridge_name='br-int',has_traffic_filtering=True,id=3b75e34d-7706-4188-9324-0d985e1994a8,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b75e34d-77') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b75e34d-77, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:07:40 user nova-compute[72990]: INFO os_vif [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:31:d3,bridge_name='br-int',has_traffic_filtering=True,id=3b75e34d-7706-4188-9324-0d985e1994a8,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b75e34d-77')
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KIMXcfZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:07:40 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:07:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce680ec4-616b-4119-be7f-b16b06dea883', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c925e9a2-93dd-4ce9-ab6f-406889d663c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aa0899-576d-435a-b726-d4187399b99f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:07:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:07:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4433d00>, {}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Disconnecting from: [] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] <== disconnect_volume: return (47ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:07:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:07:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Deleting instance files /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356_del
Aug 27 04:07:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Deletion of /opt/stack/data/nova/instances/861db154-c722-4164-a1eb-5f0bee266356_del complete
Aug 27 04:07:41 user nova-compute[72990]: INFO nova.compute.manager [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 27 04:07:41 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:07:41 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:07:41 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 861db154-c722-4164-a1eb-5f0bee266356] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:07:42 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:07:42 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Took 1.03 seconds to deallocate network for instance.
Aug 27 04:07:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-abe3ee6c-738c-4405-8596-c200dfeb0dde req-2d906e08-7494-4b11-bacb-f904eacc65f7 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Received event network-vif-deleted-3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:07:42 user nova-compute[72990]: INFO nova.compute.manager [req-abe3ee6c-738c-4405-8596-c200dfeb0dde req-2d906e08-7494-4b11-bacb-f904eacc65f7 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Neutron deleted interface 3b75e34d-7706-4188-9324-0d985e1994a8; detaching it from the instance and deleting it from the info cache
Aug 27 04:07:42 user nova-compute[72990]: DEBUG nova.network.neutron [req-abe3ee6c-738c-4405-8596-c200dfeb0dde req-2d906e08-7494-4b11-bacb-f904eacc65f7 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:07:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-abe3ee6c-738c-4405-8596-c200dfeb0dde req-2d906e08-7494-4b11-bacb-f904eacc65f7 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Detach interface failed, port_id=3b75e34d-7706-4188-9324-0d985e1994a8, reason: Instance 861db154-c722-4164-a1eb-5f0bee266356 could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 04:07:42 user nova-compute[72990]: WARNING nova.volume.cinder [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Attachment 9397ed49-c8ee-4911-b710-09fd8ae9915c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9397ed49-c8ee-4911-b710-09fd8ae9915c. (HTTP 404) (Request-ID: req-0fffb201-98d0-4403-bcbb-6de4bf7ab42a)
Aug 27 04:07:42 user nova-compute[72990]: INFO nova.compute.manager [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Took 0.03 seconds to detach 1 volumes for instance.
Aug 27 04:07:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:42 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:07:42 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:07:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:42 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Deleted allocations for instance 861db154-c722-4164-a1eb-5f0bee266356
Aug 27 04:07:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-c96b0144-5b7a-4a50-be8f-5d8282b1ce11 req-b199097f-c248-40b2-ad01-80ca93edd654 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Received event network-vif-plugged-3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:07:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c96b0144-5b7a-4a50-be8f-5d8282b1ce11 req-b199097f-c248-40b2-ad01-80ca93edd654 service nova] Acquiring lock "861db154-c722-4164-a1eb-5f0bee266356-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c96b0144-5b7a-4a50-be8f-5d8282b1ce11 req-b199097f-c248-40b2-ad01-80ca93edd654 service nova] Lock "861db154-c722-4164-a1eb-5f0bee266356-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c96b0144-5b7a-4a50-be8f-5d8282b1ce11 req-b199097f-c248-40b2-ad01-80ca93edd654 service nova] Lock "861db154-c722-4164-a1eb-5f0bee266356-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-c96b0144-5b7a-4a50-be8f-5d8282b1ce11 req-b199097f-c248-40b2-ad01-80ca93edd654 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] No waiting events found dispatching network-vif-plugged-3b75e34d-7706-4188-9324-0d985e1994a8 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:07:42 user nova-compute[72990]: WARNING nova.compute.manager [req-c96b0144-5b7a-4a50-be8f-5d8282b1ce11 req-b199097f-c248-40b2-ad01-80ca93edd654 service nova] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Received unexpected event network-vif-plugged-3b75e34d-7706-4188-9324-0d985e1994a8 for instance with vm_state deleted and task_state None.
Aug 27 04:07:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-bd31efe9-244a-492c-9bcb-90cd229f6dcc tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "861db154-c722-4164-a1eb-5f0bee266356" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.407s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:07:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:07:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:46 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:07:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "418f0216-43b8-4437-b1ee-8cbff5830c4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:07:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:46 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:07:46 user nova-compute[72990]: INFO nova.compute.claims [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Claim successful on node user
Aug 27 04:07:47 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:07:47 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:07:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:07:47 user nova-compute[72990]: INFO nova.virt.block_device [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Booting with volume snapshot 3f026b31-0645-4e72-8e2d-3d84a2d62627 at /dev/vda
Aug 27 04:07:47 user nova-compute[72990]: DEBUG nova.policy [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf3112e616344af7873a50d134260637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6b19a372f947e4aee43f9d7573e8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:07:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:48 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Successfully created port: 18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:07:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Successfully updated port: 18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "refresh_cache-418f0216-43b8-4437-b1ee-8cbff5830c4e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquired lock "refresh_cache-418f0216-43b8-4437-b1ee-8cbff5830c4e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-b18d9512-89c2-4e63-b3d2-a4ee8f3589d1 req-35c53c59-9d69-4031-b4b6-46ecae3baa0a service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Received event network-changed-18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-b18d9512-89c2-4e63-b3d2-a4ee8f3589d1 req-35c53c59-9d69-4031-b4b6-46ecae3baa0a service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Refreshing instance network info cache due to event network-changed-18f910ad-c772-4a55-bb31-6e102075aaa7. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b18d9512-89c2-4e63-b3d2-a4ee8f3589d1 req-35c53c59-9d69-4031-b4b6-46ecae3baa0a service nova] Acquiring lock "refresh_cache-418f0216-43b8-4437-b1ee-8cbff5830c4e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:49 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:07:49 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8060MB free_disk=25.014511108398438GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Updating instance_info_cache with network_info: [{"id": "18f910ad-c772-4a55-bb31-6e102075aaa7", "address": "fa:16:3e:4e:ad:c8", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f910ad-c7", "ovs_interfaceid": "18f910ad-c772-4a55-bb31-6e102075aaa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Releasing lock "refresh_cache-418f0216-43b8-4437-b1ee-8cbff5830c4e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Instance network_info: |[{"id": "18f910ad-c772-4a55-bb31-6e102075aaa7", "address": "fa:16:3e:4e:ad:c8", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f910ad-c7", "ovs_interfaceid": "18f910ad-c772-4a55-bb31-6e102075aaa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b18d9512-89c2-4e63-b3d2-a4ee8f3589d1 req-35c53c59-9d69-4031-b4b6-46ecae3baa0a service nova] Acquired lock "refresh_cache-418f0216-43b8-4437-b1ee-8cbff5830c4e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.network.neutron [req-b18d9512-89c2-4e63-b3d2-a4ee8f3589d1 req-35c53c59-9d69-4031-b4b6-46ecae3baa0a service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Refreshing network info cache for port 18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance aef3be9a-fd69-4428-97c3-1016d97ca0e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance da3f86d1-09e4-4c85-b275-145c86f1aa15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 0206498e-6ec9-4af7-a4bb-ea512b71e4be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 83ea4f5e-3381-4561-8bdb-868466b4d49d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 418f0216-43b8-4437-b1ee-8cbff5830c4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:07:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:50 user nova-compute[72990]: INFO nova.compute.manager [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Terminating instance
Aug 27 04:07:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG nova.network.neutron [req-b18d9512-89c2-4e63-b3d2-a4ee8f3589d1 req-35c53c59-9d69-4031-b4b6-46ecae3baa0a service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Updated VIF entry in instance network info cache for port 18f910ad-c772-4a55-bb31-6e102075aaa7. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG nova.network.neutron [req-b18d9512-89c2-4e63-b3d2-a4ee8f3589d1 req-35c53c59-9d69-4031-b4b6-46ecae3baa0a service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Updating instance_info_cache with network_info: [{"id": "18f910ad-c772-4a55-bb31-6e102075aaa7", "address": "fa:16:3e:4e:ad:c8", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f910ad-c7", "ovs_interfaceid": "18f910ad-c772-4a55-bb31-6e102075aaa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b18d9512-89c2-4e63-b3d2-a4ee8f3589d1 req-35c53c59-9d69-4031-b4b6-46ecae3baa0a service nova] Releasing lock "refresh_cache-418f0216-43b8-4437-b1ee-8cbff5830c4e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:51 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Instance destroyed successfully.
Aug 27 04:07:51 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lazy-loading 'resources' on Instance uuid cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1286928730',display_name='tempest-ServersNegativeTestJSON-server-1286928730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1286928730',id=33,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:58:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dabbdf88ca1498c95e36398ee38985a',ramdisk_id='',reservation_id='r-3nbcy9i2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1760637283',owner_user_name='tempest-ServersNegativeTestJSON-1760637283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T03:58:56Z,user_data=None,user_id='d5cb3e0b98574319ac56c76cc1d0a796',uuid=cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "address": "fa:16:3e:32:2f:f1", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe52f47f-bf", "ovs_interfaceid": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Converting VIF {"id": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "address": "fa:16:3e:32:2f:f1", "network": {"id": "e05a5881-de57-47e4-9edd-c8f2c10be044", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-974863139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dabbdf88ca1498c95e36398ee38985a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe52f47f-bf", "ovs_interfaceid": "fe52f47f-bfc1-41bb-869b-cb4519b2a333", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=fe52f47f-bfc1-41bb-869b-cb4519b2a333,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe52f47f-bf') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG os_vif [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=fe52f47f-bfc1-41bb-869b-cb4519b2a333,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe52f47f-bf') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe52f47f-bf, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:07:51 user nova-compute[72990]: INFO os_vif [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=fe52f47f-bfc1-41bb-869b-cb4519b2a333,network=Network(e05a5881-de57-47e4-9edd-c8f2c10be044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe52f47f-bf')
Aug 27 04:07:51 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Deleting instance files /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3_del
Aug 27 04:07:51 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Deletion of /opt/stack/data/nova/instances/cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3_del complete
Aug 27 04:07:51 user nova-compute[72990]: INFO nova.compute.manager [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 27 04:07:51 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG nova.compute.manager [req-8bff4fe3-6fd0-4fcd-9eee-e6ab31bd0545 req-82fcb9bd-a6ca-4d3b-a36d-d7c325dddb37 service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Received event network-vif-unplugged-fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8bff4fe3-6fd0-4fcd-9eee-e6ab31bd0545 req-82fcb9bd-a6ca-4d3b-a36d-d7c325dddb37 service nova] Acquiring lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8bff4fe3-6fd0-4fcd-9eee-e6ab31bd0545 req-82fcb9bd-a6ca-4d3b-a36d-d7c325dddb37 service nova] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8bff4fe3-6fd0-4fcd-9eee-e6ab31bd0545 req-82fcb9bd-a6ca-4d3b-a36d-d7c325dddb37 service nova] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG nova.compute.manager [req-8bff4fe3-6fd0-4fcd-9eee-e6ab31bd0545 req-82fcb9bd-a6ca-4d3b-a36d-d7c325dddb37 service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] No waiting events found dispatching network-vif-unplugged-fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG nova.compute.manager [req-8bff4fe3-6fd0-4fcd-9eee-e6ab31bd0545 req-82fcb9bd-a6ca-4d3b-a36d-d7c325dddb37 service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Received event network-vif-unplugged-fe52f47f-bfc1-41bb-869b-cb4519b2a333 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG nova.compute.manager [req-8bff4fe3-6fd0-4fcd-9eee-e6ab31bd0545 req-82fcb9bd-a6ca-4d3b-a36d-d7c325dddb37 service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Received event network-vif-plugged-fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8bff4fe3-6fd0-4fcd-9eee-e6ab31bd0545 req-82fcb9bd-a6ca-4d3b-a36d-d7c325dddb37 service nova] Acquiring lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8bff4fe3-6fd0-4fcd-9eee-e6ab31bd0545 req-82fcb9bd-a6ca-4d3b-a36d-d7c325dddb37 service nova] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8bff4fe3-6fd0-4fcd-9eee-e6ab31bd0545 req-82fcb9bd-a6ca-4d3b-a36d-d7c325dddb37 service nova] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:51 user nova-compute[72990]: DEBUG nova.compute.manager [req-8bff4fe3-6fd0-4fcd-9eee-e6ab31bd0545 req-82fcb9bd-a6ca-4d3b-a36d-d7c325dddb37 service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] No waiting events found dispatching network-vif-plugged-fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:07:51 user nova-compute[72990]: WARNING nova.compute.manager [req-8bff4fe3-6fd0-4fcd-9eee-e6ab31bd0545 req-82fcb9bd-a6ca-4d3b-a36d-d7c325dddb37 service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Received unexpected event network-vif-plugged-fe52f47f-bfc1-41bb-869b-cb4519b2a333 for instance with vm_state active and task_state deleting.
Aug 27 04:07:52 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:07:52 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Took 0.92 seconds to deallocate network for instance.
Aug 27 04:07:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Skipping network cache update for instance because it is Building. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:52 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Deleted allocations for instance cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3
Aug 27 04:07:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f781ca97-100f-4a0b-a342-5b6c8b0f83d2 tempest-ServersNegativeTestJSON-1760637283 tempest-ServersNegativeTestJSON-1760637283-project-member] Lock "cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.060s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updating instance_info_cache with network_info: [{"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-aef3be9a-fd69-4428-97c3-1016d97ca0e9" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:07:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:07:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-38d1256c-a302-4541-9af2-844a96c64a4b req-0a27b0fe-a7b2-4225-983f-493c6cd48b3f service nova] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Received event network-vif-deleted-fe52f47f-bfc1-41bb-869b-cb4519b2a333 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:07:55 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109260.8921247, 861db154-c722-4164-a1eb-5f0bee266356 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:07:55 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 861db154-c722-4164-a1eb-5f0bee266356] VM Stopped (Lifecycle Event)
Aug 27 04:07:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-32355a8e-d8c2-4324-aa47-ad852386c9d7 None None] [instance: 861db154-c722-4164-a1eb-5f0bee266356] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:07:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:57 user nova-compute[72990]: DEBUG os_brick.utils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:07:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[518fc762-88a2-4d86-b1e7-9afe04415de0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9dec4e-d6c0-41fa-b7e9-572b869169e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b47756c-9952-4bc1-a617-a65a74158ffa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfef77e7-510a-416c-9699-c0726868aa2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:07:58 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d687553f-2438-475f-8d62-b53cc2ca80e9]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG os_brick.utils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Updating existing volume attachment record: d6d9b4c0-b32d-4e05-9753-d11e1d7ba1e3 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:58 user nova-compute[72990]: INFO nova.compute.manager [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Terminating instance
Aug 27 04:07:58 user nova-compute[72990]: DEBUG nova.compute.manager [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG nova.compute.manager [req-bb0891ab-ff39-42cc-bc5f-710e67e874a2 req-e4f14706-c571-4bb6-8cae-ecbb2d49c641 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-unplugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bb0891ab-ff39-42cc-bc5f-710e67e874a2 req-e4f14706-c571-4bb6-8cae-ecbb2d49c641 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bb0891ab-ff39-42cc-bc5f-710e67e874a2 req-e4f14706-c571-4bb6-8cae-ecbb2d49c641 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bb0891ab-ff39-42cc-bc5f-710e67e874a2 req-e4f14706-c571-4bb6-8cae-ecbb2d49c641 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG nova.compute.manager [req-bb0891ab-ff39-42cc-bc5f-710e67e874a2 req-e4f14706-c571-4bb6-8cae-ecbb2d49c641 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-unplugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG nova.compute.manager [req-bb0891ab-ff39-42cc-bc5f-710e67e874a2 req-e4f14706-c571-4bb6-8cae-ecbb2d49c641 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-unplugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:59 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Instance destroyed successfully.
Aug 27 04:07:59 user nova-compute[72990]: DEBUG nova.objects.instance [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'resources' on Instance uuid aef3be9a-fd69-4428-97c3-1016d97ca0e9 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T03:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1823636413',display_name='tempest-AttachVolumeTestJSON-server-1823636413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1823636413',id=32,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZNGdZSsfPtAguFJDKN3iVgvVi0aLXdyqROhiDmpQVPMLbPrj6LNqo6zh2eRkFzKq35WCkDJ3pahxf33JmxUgZuGyUraQp1NA3CDVXGmGeP0bYPK2BVWcRuq13QnqVJqg==',key_name='tempest-keypair-1602283704',keypairs=<?>,launch_index=0,launched_at=2023-08-27T03:58:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2d0a8267a0042a0ad831e7b91889dc7',ramdisk_id='',reservation_id='r-2qv66d4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-698620353',owner_user_name='tempest-AttachVolumeTestJSON-698620353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:06:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5711f5c9c8344de79b246e7eb8661ff2',uuid=aef3be9a-fd69-4428-97c3-1016d97ca0e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converting VIF {"id": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "address": "fa:16:3e:dc:26:ce", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d5b0ac-30", "ovs_interfaceid": "35d5b0ac-308b-4a82-a29d-63bbe0c8ab70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG os_vif [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35d5b0ac-30, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:07:59 user nova-compute[72990]: INFO os_vif [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:26:ce,bridge_name='br-int',has_traffic_filtering=True,id=35d5b0ac-308b-4a82-a29d-63bbe0c8ab70,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d5b0ac-30')
Aug 27 04:07:59 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Deleting instance files /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9_del
Aug 27 04:07:59 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Deletion of /opt/stack/data/nova/instances/aef3be9a-fd69-4428-97c3-1016d97ca0e9_del complete
Aug 27 04:07:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:59 user nova-compute[72990]: INFO nova.compute.manager [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 27 04:07:59 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:07:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:00 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:00 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:00 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:08:00 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Took 1.38 seconds to deallocate network for instance.
Aug 27 04:08:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:01 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Deleted allocations for instance aef3be9a-fd69-4428-97c3-1016d97ca0e9
Aug 27 04:08:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:08:01 user nova-compute[72990]: WARNING nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state deleted and task_state None.
Aug 27 04:08:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:08:01 user nova-compute[72990]: WARNING nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state deleted and task_state None.
Aug 27 04:08:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:08:01 user nova-compute[72990]: WARNING nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state deleted and task_state None.
Aug 27 04:08:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] Acquiring lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] No waiting events found dispatching network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:08:01 user nova-compute[72990]: WARNING nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received unexpected event network-vif-plugged-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 for instance with vm_state deleted and task_state None.
Aug 27 04:08:01 user nova-compute[72990]: DEBUG nova.compute.manager [req-489ae20b-3603-4973-85e9-d38b9936f37b req-6b00f65d-f889-4af0-b8c3-741f3e255a82 service nova] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Received event network-vif-deleted-35d5b0ac-308b-4a82-a29d-63bbe0c8ab70 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-28fd3ea2-ad3d-4193-ac03-3204f99cc802 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "aef3be9a-fd69-4428-97c3-1016d97ca0e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.858s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:06 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109271.0224302, cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:08:06 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] VM Stopped (Lifecycle Event)
Aug 27 04:08:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a8ea07a0-341a-4a2d-8eff-a86220b0cd6b None None] [instance: cdfb37d3-ff52-4c97-ba02-ca8e9f7affa3] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:08:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:08:09 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Creating image(s)
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Ensure instance console log exists: /opt/stack/data/nova/instances/418f0216-43b8-4437-b1ee-8cbff5830c4e/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Start _get_guest_xml network_info=[{"id": "18f910ad-c772-4a55-bb31-6e102075aaa7", "address": "fa:16:3e:4e:ad:c8", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f910ad-c7", "ovs_interfaceid": "18f910ad-c772-4a55-bb31-6e102075aaa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-27T04:07:27Z,direct_url=<?>,disk_format='qcow2',id=d32b23e6-ff6e-45fb-aa8b-7538aa420613,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1713861984',owner='6d6b19a372f947e4aee43f9d7573e8f7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-27T04:07:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'd6d9b4c0-b32d-4e05-9753-d11e1d7ba1e3', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwPxCtDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '418f0216-43b8-4437-b1ee-8cbff5830c4e', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcabd81a-47f9-4e47-8518-adb7d5c536d0', 'serial': 'bcabd81a-47f9-4e47-8518-adb7d5c536d0'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:08:09 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:08:09 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-27T04:07:27Z,direct_url=<?>,disk_format='qcow2',id=d32b23e6-ff6e-45fb-aa8b-7538aa420613,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1713861984',owner='6d6b19a372f947e4aee43f9d7573e8f7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-27T04:07:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwPxCtDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:08:09 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:08:09 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:08:09 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a5d940-3aad-456f-9dee-ec6e7c61a30c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:08:09 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[472322b1-86d9-41c5-8368-977bd0f046c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0] added
Aug 27 04:08:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[189d33ad-ae51-42cf-b3b2-39e6fcf1106b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9afeeba-86ac-4007-ab24-b6a49966c7d7]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwPxCtDo {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwPxCtDo" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcbf7da-e9f5-4a7a-a5d4-1a036b5a665a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EwPxCtDo'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc081770-0146-44fb-ba4e-9b2600cd0ceb]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4fca1f-e1d2-4119-ada3-e80b09c7d560]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:08:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:08:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee28857-7ddb-4869-9571-0760d0e2c3e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0, portal: 172.16.0.220,3260]
Aug 27 04:08:09 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0, portal: 172.16.0.220,3260] successful.
Aug 27 04:08:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[43397c9e-606b-49e5-a0e6-3d790f11bd20]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e615794a-8717-4a03-af22-e72a70986327]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:08:09 user nova-compute[72990]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)
Aug 27 04:08:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:08:09 user nova-compute[72990]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)
Aug 27 04:08:09 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[841b7c1f-ae83-4e44-8aaa-bd8d74dd1887]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:09 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwPxCtDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23566626461366234', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566626461366234', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1929439534',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1929439534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1929439534',id=43,image_ref='d32b23e6-ff6e-45fb-aa8b-7538aa420613',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCL21EifoDTk77ptq71XyPAyTP9QQaW8fAvHPB5edMVRrDn/LvTTdt31MCHareajPbv6WW8lKmLozmeSF1s4zisMeiqtzW68zwp4AH0gpV7L1sXMT9dnrNewt0MaP9eKWA==',key_name='tempest-keypair-1168611090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-ev7pcb29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1834919775',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf3112e616344af7873a50d134260637',uuid=418f0216-43b8-4437-b1ee-8cbff5830c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18f910ad-c772-4a55-bb31-6e102075aaa7", "address": "fa:16:3e:4e:ad:c8", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f910ad-c7", "ovs_interfaceid": "18f910ad-c772-4a55-bb31-6e102075aaa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "18f910ad-c772-4a55-bb31-6e102075aaa7", "address": "fa:16:3e:4e:ad:c8", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f910ad-c7", "ovs_interfaceid": "18f910ad-c772-4a55-bb31-6e102075aaa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ad:c8,bridge_name='br-int',has_traffic_filtering=True,id=18f910ad-c772-4a55-bb31-6e102075aaa7,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f910ad-c7') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lazy-loading 'pci_devices' on Instance uuid 418f0216-43b8-4437-b1ee-8cbff5830c4e {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:08:10 user nova-compute[72990]:   <uuid>418f0216-43b8-4437-b1ee-8cbff5830c4e</uuid>
Aug 27 04:08:10 user nova-compute[72990]:   <name>instance-0000002b</name>
Aug 27 04:08:10 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:08:10 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:08:10 user nova-compute[72990]:   <metadata>
Aug 27 04:08:10 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:08:10 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:08:10 user nova-compute[72990]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1929439534</nova:name>
Aug 27 04:08:10 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:08:09</nova:creationTime>
Aug 27 04:08:10 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:08:10 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:08:10 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:08:10 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:08:10 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:08:10 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:08:10 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:08:10 user nova-compute[72990]:       <nova:owner>
Aug 27 04:08:10 user nova-compute[72990]:         <nova:user uuid="cf3112e616344af7873a50d134260637">tempest-TestVolumeBootPattern-1834919775-project-member</nova:user>
Aug 27 04:08:10 user nova-compute[72990]:         <nova:project uuid="6d6b19a372f947e4aee43f9d7573e8f7">tempest-TestVolumeBootPattern-1834919775</nova:project>
Aug 27 04:08:10 user nova-compute[72990]:       </nova:owner>
Aug 27 04:08:10 user nova-compute[72990]:       <nova:root type="image" uuid="d32b23e6-ff6e-45fb-aa8b-7538aa420613"/>
Aug 27 04:08:10 user nova-compute[72990]:       <nova:ports>
Aug 27 04:08:10 user nova-compute[72990]:         <nova:port uuid="18f910ad-c772-4a55-bb31-6e102075aaa7">
Aug 27 04:08:10 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 04:08:10 user nova-compute[72990]:         </nova:port>
Aug 27 04:08:10 user nova-compute[72990]:       </nova:ports>
Aug 27 04:08:10 user nova-compute[72990]:     </nova:instance>
Aug 27 04:08:10 user nova-compute[72990]:   </metadata>
Aug 27 04:08:10 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:08:10 user nova-compute[72990]:     <system>
Aug 27 04:08:10 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:08:10 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:08:10 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:08:10 user nova-compute[72990]:       <entry name="serial">418f0216-43b8-4437-b1ee-8cbff5830c4e</entry>
Aug 27 04:08:10 user nova-compute[72990]:       <entry name="uuid">418f0216-43b8-4437-b1ee-8cbff5830c4e</entry>
Aug 27 04:08:10 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:08:10 user nova-compute[72990]:     </system>
Aug 27 04:08:10 user nova-compute[72990]:   </sysinfo>
Aug 27 04:08:10 user nova-compute[72990]:   <os>
Aug 27 04:08:10 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:08:10 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:08:10 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:08:10 user nova-compute[72990]:   </os>
Aug 27 04:08:10 user nova-compute[72990]:   <features>
Aug 27 04:08:10 user nova-compute[72990]:     <acpi/>
Aug 27 04:08:10 user nova-compute[72990]:     <apic/>
Aug 27 04:08:10 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:08:10 user nova-compute[72990]:   </features>
Aug 27 04:08:10 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:08:10 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:08:10 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:08:10 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:08:10 user nova-compute[72990]:   </clock>
Aug 27 04:08:10 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:08:10 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:08:10 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:08:10 user nova-compute[72990]:   </cpu>
Aug 27 04:08:10 user nova-compute[72990]:   <devices>
Aug 27 04:08:10 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 04:08:10 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:08:10 user nova-compute[72990]:       <source dev="/dev/sdc"/>
Aug 27 04:08:10 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:08:10 user nova-compute[72990]:       <serial>bcabd81a-47f9-4e47-8518-adb7d5c536d0</serial>
Aug 27 04:08:10 user nova-compute[72990]:     </disk>
Aug 27 04:08:10 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:08:10 user nova-compute[72990]:       <mac address="fa:16:3e:4e:ad:c8"/>
Aug 27 04:08:10 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:08:10 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:08:10 user nova-compute[72990]:       <target dev="tap18f910ad-c7"/>
Aug 27 04:08:10 user nova-compute[72990]:     </interface>
Aug 27 04:08:10 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:08:10 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/418f0216-43b8-4437-b1ee-8cbff5830c4e/console.log" append="off"/>
Aug 27 04:08:10 user nova-compute[72990]:     </serial>
Aug 27 04:08:10 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:08:10 user nova-compute[72990]:     <video>
Aug 27 04:08:10 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:08:10 user nova-compute[72990]:     </video>
Aug 27 04:08:10 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:08:10 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:08:10 user nova-compute[72990]:     </rng>
Aug 27 04:08:10 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:08:10 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:08:10 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:08:10 user nova-compute[72990]:     </memballoon>
Aug 27 04:08:10 user nova-compute[72990]:   </devices>
Aug 27 04:08:10 user nova-compute[72990]: </domain>
Aug 27 04:08:10 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1929439534',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1929439534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1929439534',id=43,image_ref='d32b23e6-ff6e-45fb-aa8b-7538aa420613',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCL21EifoDTk77ptq71XyPAyTP9QQaW8fAvHPB5edMVRrDn/LvTTdt31MCHareajPbv6WW8lKmLozmeSF1s4zisMeiqtzW68zwp4AH0gpV7L1sXMT9dnrNewt0MaP9eKWA==',key_name='tempest-keypair-1168611090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-ev7pcb29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1834919775',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf3112e616344af7873a50d134260637',uuid=418f0216-43b8-4437-b1ee-8cbff5830c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18f910ad-c772-4a55-bb31-6e102075aaa7", "address": "fa:16:3e:4e:ad:c8", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f910ad-c7", "ovs_interfaceid": "18f910ad-c772-4a55-bb31-6e102075aaa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "18f910ad-c772-4a55-bb31-6e102075aaa7", "address": "fa:16:3e:4e:ad:c8", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f910ad-c7", "ovs_interfaceid": "18f910ad-c772-4a55-bb31-6e102075aaa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ad:c8,bridge_name='br-int',has_traffic_filtering=True,id=18f910ad-c772-4a55-bb31-6e102075aaa7,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f910ad-c7') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG os_vif [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ad:c8,bridge_name='br-int',has_traffic_filtering=True,id=18f910ad-c772-4a55-bb31-6e102075aaa7,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f910ad-c7') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18f910ad-c7, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18f910ad-c7, col_values=(('external_ids', {'iface-id': '18f910ad-c772-4a55-bb31-6e102075aaa7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:ad:c8', 'vm-uuid': '418f0216-43b8-4437-b1ee-8cbff5830c4e'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:10 user nova-compute[72990]: INFO os_vif [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ad:c8,bridge_name='br-int',has_traffic_filtering=True,id=18f910ad-c772-4a55-bb31-6e102075aaa7,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f910ad-c7')
Aug 27 04:08:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:08:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] No VIF found with MAC fa:16:3e:4e:ad:c8, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:08:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:12 user nova-compute[72990]: DEBUG nova.compute.manager [req-2b7a26d6-c60d-41f2-aa1b-8b1b6f5e32b6 req-de756945-146d-4b62-a093-abb6dbc2cdbf service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Received event network-vif-plugged-18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2b7a26d6-c60d-41f2-aa1b-8b1b6f5e32b6 req-de756945-146d-4b62-a093-abb6dbc2cdbf service nova] Acquiring lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2b7a26d6-c60d-41f2-aa1b-8b1b6f5e32b6 req-de756945-146d-4b62-a093-abb6dbc2cdbf service nova] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-2b7a26d6-c60d-41f2-aa1b-8b1b6f5e32b6 req-de756945-146d-4b62-a093-abb6dbc2cdbf service nova] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:12 user nova-compute[72990]: DEBUG nova.compute.manager [req-2b7a26d6-c60d-41f2-aa1b-8b1b6f5e32b6 req-de756945-146d-4b62-a093-abb6dbc2cdbf service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] No waiting events found dispatching network-vif-plugged-18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:08:12 user nova-compute[72990]: WARNING nova.compute.manager [req-2b7a26d6-c60d-41f2-aa1b-8b1b6f5e32b6 req-de756945-146d-4b62-a093-abb6dbc2cdbf service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Received unexpected event network-vif-plugged-18f910ad-c772-4a55-bb31-6e102075aaa7 for instance with vm_state building and task_state spawning.
Aug 27 04:08:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109279.3264353, aef3be9a-fd69-4428-97c3-1016d97ca0e9 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:08:14 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] VM Stopped (Lifecycle Event)
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3acfe87b-7ed7-43b2-8e50-32c9a609ab96 None None] [instance: aef3be9a-fd69-4428-97c3-1016d97ca0e9] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109294.4343393, 418f0216-43b8-4437-b1ee-8cbff5830c4e => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:08:14 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] VM Resumed (Lifecycle Event)
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:08:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Instance spawned successfully.
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:08:14 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109294.4355102, 418f0216-43b8-4437-b1ee-8cbff5830c4e => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:08:14 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] VM Started (Lifecycle Event)
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-289fdf65-0aac-4a2c-8e16-2e20aadccf1d req-8de6ee74-1e90-4866-97e9-df0843808769 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Received event network-vif-plugged-18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-289fdf65-0aac-4a2c-8e16-2e20aadccf1d req-8de6ee74-1e90-4866-97e9-df0843808769 service nova] Acquiring lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-289fdf65-0aac-4a2c-8e16-2e20aadccf1d req-8de6ee74-1e90-4866-97e9-df0843808769 service nova] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-289fdf65-0aac-4a2c-8e16-2e20aadccf1d req-8de6ee74-1e90-4866-97e9-df0843808769 service nova] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.compute.manager [req-289fdf65-0aac-4a2c-8e16-2e20aadccf1d req-8de6ee74-1e90-4866-97e9-df0843808769 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] No waiting events found dispatching network-vif-plugged-18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:08:14 user nova-compute[72990]: WARNING nova.compute.manager [req-289fdf65-0aac-4a2c-8e16-2e20aadccf1d req-8de6ee74-1e90-4866-97e9-df0843808769 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Received unexpected event network-vif-plugged-18f910ad-c772-4a55-bb31-6e102075aaa7 for instance with vm_state building and task_state spawning.
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:08:14 user nova-compute[72990]: INFO nova.compute.manager [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 27 04:08:14 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:08:14 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:08:14 user nova-compute[72990]: INFO nova.compute.manager [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Took 27.84 seconds to build instance.
Aug 27 04:08:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dc6be293-46a4-4984-a054-38e431a83405 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.940s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:08:19 user nova-compute[72990]: INFO nova.compute.claims [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Claim successful on node user
Aug 27 04:08:19 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG nova.network.neutron [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:08:19 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:08:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG nova.policy [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a2bca29600d4e3e8915894716b24bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2eb083c82b4dfcbad70f865367a84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG nova.compute.manager [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:08:19 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Creating image(s)
Aug 27 04:08:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "/opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "/opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "7df0faf65069ce3d2e61053d83affe17893c6102" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "7df0faf65069ce3d2e61053d83affe17893c6102" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102.part --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102.part --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:20 user nova-compute[72990]: DEBUG nova.virt.images [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] e974cd05-3280-4593-a8a7-bd5320760de9 was qcow2, converting to raw {{(pid=72990) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 04:08:20 user nova-compute[72990]: DEBUG nova.privsep.utils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72990) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 04:08:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102.part /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102.converted {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:20 user nova-compute[72990]: DEBUG nova.network.neutron [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Successfully created port: 04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:08:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102.part /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102.converted" returned: 0 in 0.631s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102.converted --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "7df0faf65069ce3d2e61053d83affe17893c6102" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.479s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG nova.network.neutron [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Successfully updated port: 04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102 --force-share --output=json" returned: 0 in 0.195s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "7df0faf65069ce3d2e61053d83affe17893c6102" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "7df0faf65069ce3d2e61053d83affe17893c6102" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquired lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG nova.network.neutron [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG nova.compute.manager [req-9f6df53e-b9ba-495c-a675-db3079411c3a req-5119ca7b-7096-4485-a9dc-80c070dc81f0 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-changed-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG nova.compute.manager [req-9f6df53e-b9ba-495c-a675-db3079411c3a req-5119ca7b-7096-4485-a9dc-80c070dc81f0 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Refreshing instance network info cache due to event network-changed-04dc6ccc-6386-4870-86a2-2cfd0973ec3a. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9f6df53e-b9ba-495c-a675-db3079411c3a req-5119ca7b-7096-4485-a9dc-80c070dc81f0 service nova] Acquiring lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG nova.network.neutron [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102 --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102,backing_fmt=raw /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102,backing_fmt=raw /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk 1073741824" returned: 0 in 0.052s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "7df0faf65069ce3d2e61053d83affe17893c6102" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102 --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:21 user nova-compute[72990]: DEBUG nova.network.neutron [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updating instance_info_cache with network_info: [{"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Releasing lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Instance network_info: |[{"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9f6df53e-b9ba-495c-a675-db3079411c3a req-5119ca7b-7096-4485-a9dc-80c070dc81f0 service nova] Acquired lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.network.neutron [req-9f6df53e-b9ba-495c-a675-db3079411c3a req-5119ca7b-7096-4485-a9dc-80c070dc81f0 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Refreshing network info cache for port 04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Cannot resize image /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Ensure instance console log exists: /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Start _get_guest_xml network_info=[{"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:08:16Z,direct_url=<?>,disk_format='qcow2',id=e974cd05-3280-4593-a8a7-bd5320760de9,min_disk=0,min_ram=0,name='tempest-scenario-img--155825469',owner='2b2eb083c82b4dfcbad70f865367a84a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:08:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'e974cd05-3280-4593-a8a7-bd5320760de9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:08:22 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:08:22 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:08:16Z,direct_url=<?>,disk_format='qcow2',id=e974cd05-3280-4593-a8a7-bd5320760de9,min_disk=0,min_ram=0,name='tempest-scenario-img--155825469',owner='2b2eb083c82b4dfcbad70f865367a84a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:08:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-113645242',display_name='tempest-TestMinimumBasicScenario-server-113645242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-113645242',id=44,image_ref='e974cd05-3280-4593-a8a7-bd5320760de9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMePMsKabLu6DdPJCYVZvdqJr7DT8Fg2ju1oAMSkNGRcx5z0JjFHObhmQEZFe+dZRe9b28saTqmVvP+52HKoi09AsSL7Ko60fyM8vs9KTOTQn+BfOScX2V2frLCIGTxgA==',key_name='tempest-TestMinimumBasicScenario-263442039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b2eb083c82b4dfcbad70f865367a84a',ramdisk_id='',reservation_id='r-2xtbghow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e974cd05-3280-4593-a8a7-bd5320760de9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1213348251',owner_user_name='tempest-TestMinimumBasicScenario-1213348251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:08:20Z,user_data=None,user_id='8a2bca29600d4e3e8915894716b24bdc',uuid=b0392f8e-364d-450b-84c7-7b3f631a3a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Converting VIF {"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d3:f0,bridge_name='br-int',has_traffic_filtering=True,id=04dc6ccc-6386-4870-86a2-2cfd0973ec3a,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc6ccc-63') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.objects.instance [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lazy-loading 'pci_devices' on Instance uuid b0392f8e-364d-450b-84c7-7b3f631a3a58 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:08:22 user nova-compute[72990]:   <uuid>b0392f8e-364d-450b-84c7-7b3f631a3a58</uuid>
Aug 27 04:08:22 user nova-compute[72990]:   <name>instance-0000002c</name>
Aug 27 04:08:22 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:08:22 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:08:22 user nova-compute[72990]:   <metadata>
Aug 27 04:08:22 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:08:22 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:08:22 user nova-compute[72990]:       <nova:name>tempest-TestMinimumBasicScenario-server-113645242</nova:name>
Aug 27 04:08:22 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:08:22</nova:creationTime>
Aug 27 04:08:22 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:08:22 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:08:22 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:08:22 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:08:22 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:08:22 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:08:22 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:08:22 user nova-compute[72990]:       <nova:owner>
Aug 27 04:08:22 user nova-compute[72990]:         <nova:user uuid="8a2bca29600d4e3e8915894716b24bdc">tempest-TestMinimumBasicScenario-1213348251-project-member</nova:user>
Aug 27 04:08:22 user nova-compute[72990]:         <nova:project uuid="2b2eb083c82b4dfcbad70f865367a84a">tempest-TestMinimumBasicScenario-1213348251</nova:project>
Aug 27 04:08:22 user nova-compute[72990]:       </nova:owner>
Aug 27 04:08:22 user nova-compute[72990]:       <nova:root type="image" uuid="e974cd05-3280-4593-a8a7-bd5320760de9"/>
Aug 27 04:08:22 user nova-compute[72990]:       <nova:ports>
Aug 27 04:08:22 user nova-compute[72990]:         <nova:port uuid="04dc6ccc-6386-4870-86a2-2cfd0973ec3a">
Aug 27 04:08:22 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 04:08:22 user nova-compute[72990]:         </nova:port>
Aug 27 04:08:22 user nova-compute[72990]:       </nova:ports>
Aug 27 04:08:22 user nova-compute[72990]:     </nova:instance>
Aug 27 04:08:22 user nova-compute[72990]:   </metadata>
Aug 27 04:08:22 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:08:22 user nova-compute[72990]:     <system>
Aug 27 04:08:22 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:08:22 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:08:22 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:08:22 user nova-compute[72990]:       <entry name="serial">b0392f8e-364d-450b-84c7-7b3f631a3a58</entry>
Aug 27 04:08:22 user nova-compute[72990]:       <entry name="uuid">b0392f8e-364d-450b-84c7-7b3f631a3a58</entry>
Aug 27 04:08:22 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:08:22 user nova-compute[72990]:     </system>
Aug 27 04:08:22 user nova-compute[72990]:   </sysinfo>
Aug 27 04:08:22 user nova-compute[72990]:   <os>
Aug 27 04:08:22 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:08:22 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:08:22 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:08:22 user nova-compute[72990]:   </os>
Aug 27 04:08:22 user nova-compute[72990]:   <features>
Aug 27 04:08:22 user nova-compute[72990]:     <acpi/>
Aug 27 04:08:22 user nova-compute[72990]:     <apic/>
Aug 27 04:08:22 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:08:22 user nova-compute[72990]:   </features>
Aug 27 04:08:22 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:08:22 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:08:22 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:08:22 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:08:22 user nova-compute[72990]:   </clock>
Aug 27 04:08:22 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:08:22 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:08:22 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:08:22 user nova-compute[72990]:   </cpu>
Aug 27 04:08:22 user nova-compute[72990]:   <devices>
Aug 27 04:08:22 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:08:22 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:08:22 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk"/>
Aug 27 04:08:22 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:08:22 user nova-compute[72990]:     </disk>
Aug 27 04:08:22 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:08:22 user nova-compute[72990]:       <mac address="fa:16:3e:f4:d3:f0"/>
Aug 27 04:08:22 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:08:22 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:08:22 user nova-compute[72990]:       <target dev="tap04dc6ccc-63"/>
Aug 27 04:08:22 user nova-compute[72990]:     </interface>
Aug 27 04:08:22 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:08:22 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/console.log" append="off"/>
Aug 27 04:08:22 user nova-compute[72990]:     </serial>
Aug 27 04:08:22 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:08:22 user nova-compute[72990]:     <video>
Aug 27 04:08:22 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:08:22 user nova-compute[72990]:     </video>
Aug 27 04:08:22 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:08:22 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:08:22 user nova-compute[72990]:     </rng>
Aug 27 04:08:22 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:08:22 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:08:22 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:08:22 user nova-compute[72990]:     </memballoon>
Aug 27 04:08:22 user nova-compute[72990]:   </devices>
Aug 27 04:08:22 user nova-compute[72990]: </domain>
Aug 27 04:08:22 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-113645242',display_name='tempest-TestMinimumBasicScenario-server-113645242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-113645242',id=44,image_ref='e974cd05-3280-4593-a8a7-bd5320760de9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMePMsKabLu6DdPJCYVZvdqJr7DT8Fg2ju1oAMSkNGRcx5z0JjFHObhmQEZFe+dZRe9b28saTqmVvP+52HKoi09AsSL7Ko60fyM8vs9KTOTQn+BfOScX2V2frLCIGTxgA==',key_name='tempest-TestMinimumBasicScenario-263442039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b2eb083c82b4dfcbad70f865367a84a',ramdisk_id='',reservation_id='r-2xtbghow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e974cd05-3280-4593-a8a7-bd5320760de9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1213348251',owner_user_name='tempest-TestMinimumBasicScenario-1213348251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:08:20Z,user_data=None,user_id='8a2bca29600d4e3e8915894716b24bdc',uuid=b0392f8e-364d-450b-84c7-7b3f631a3a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Converting VIF {"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d3:f0,bridge_name='br-int',has_traffic_filtering=True,id=04dc6ccc-6386-4870-86a2-2cfd0973ec3a,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc6ccc-63') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG os_vif [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d3:f0,bridge_name='br-int',has_traffic_filtering=True,id=04dc6ccc-6386-4870-86a2-2cfd0973ec3a,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc6ccc-63') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04dc6ccc-63, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04dc6ccc-63, col_values=(('external_ids', {'iface-id': '04dc6ccc-6386-4870-86a2-2cfd0973ec3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:d3:f0', 'vm-uuid': 'b0392f8e-364d-450b-84c7-7b3f631a3a58'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:22 user nova-compute[72990]: INFO os_vif [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d3:f0,bridge_name='br-int',has_traffic_filtering=True,id=04dc6ccc-6386-4870-86a2-2cfd0973ec3a,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc6ccc-63')
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] No VIF found with MAC fa:16:3e:f4:d3:f0, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.network.neutron [req-9f6df53e-b9ba-495c-a675-db3079411c3a req-5119ca7b-7096-4485-a9dc-80c070dc81f0 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updated VIF entry in instance network info cache for port 04dc6ccc-6386-4870-86a2-2cfd0973ec3a. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG nova.network.neutron [req-9f6df53e-b9ba-495c-a675-db3079411c3a req-5119ca7b-7096-4485-a9dc-80c070dc81f0 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updating instance_info_cache with network_info: [{"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:08:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9f6df53e-b9ba-495c-a675-db3079411c3a req-5119ca7b-7096-4485-a9dc-80c070dc81f0 service nova] Releasing lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:08:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-48f8081d-f90a-4607-92cb-e5c77197e7e1 req-99628eaa-85f1-4ea3-b48e-f9e532e47b53 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-48f8081d-f90a-4607-92cb-e5c77197e7e1 req-99628eaa-85f1-4ea3-b48e-f9e532e47b53 service nova] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-48f8081d-f90a-4607-92cb-e5c77197e7e1 req-99628eaa-85f1-4ea3-b48e-f9e532e47b53 service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-48f8081d-f90a-4607-92cb-e5c77197e7e1 req-99628eaa-85f1-4ea3-b48e-f9e532e47b53 service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:23 user nova-compute[72990]: DEBUG nova.compute.manager [req-48f8081d-f90a-4607-92cb-e5c77197e7e1 req-99628eaa-85f1-4ea3-b48e-f9e532e47b53 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] No waiting events found dispatching network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:08:23 user nova-compute[72990]: WARNING nova.compute.manager [req-48f8081d-f90a-4607-92cb-e5c77197e7e1 req-99628eaa-85f1-4ea3-b48e-f9e532e47b53 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received unexpected event network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a for instance with vm_state building and task_state spawning.
Aug 27 04:08:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109305.658926, b0392f8e-364d-450b-84c7-7b3f631a3a58 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:08:25 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] VM Resumed (Lifecycle Event)
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.compute.manager [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:08:25 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Instance spawned successfully.
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:25 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109305.6625152, b0392f8e-364d-450b-84c7-7b3f631a3a58 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:08:25 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] VM Started (Lifecycle Event)
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:08:25 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:08:25 user nova-compute[72990]: INFO nova.compute.manager [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.compute.manager [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-6c378a3e-7898-4861-b9e5-ce94022deff7 req-40f8a58c-8f47-4335-925d-54d8bb15b404 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6c378a3e-7898-4861-b9e5-ce94022deff7 req-40f8a58c-8f47-4335-925d-54d8bb15b404 service nova] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6c378a3e-7898-4861-b9e5-ce94022deff7 req-40f8a58c-8f47-4335-925d-54d8bb15b404 service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6c378a3e-7898-4861-b9e5-ce94022deff7 req-40f8a58c-8f47-4335-925d-54d8bb15b404 service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-6c378a3e-7898-4861-b9e5-ce94022deff7 req-40f8a58c-8f47-4335-925d-54d8bb15b404 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] No waiting events found dispatching network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:08:25 user nova-compute[72990]: WARNING nova.compute.manager [req-6c378a3e-7898-4861-b9e5-ce94022deff7 req-40f8a58c-8f47-4335-925d-54d8bb15b404 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received unexpected event network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a for instance with vm_state building and task_state spawning.
Aug 27 04:08:25 user nova-compute[72990]: INFO nova.compute.manager [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Took 6.60 seconds to build instance.
Aug 27 04:08:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-eef68321-a979-458c-8c66-58569c04c289 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.704s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-6dc449db-8e4e-4c37-804c-7f35470b7b8f req-2e85721c-1f52-4fba-a998-62521ba99452 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Received event network-changed-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-6dc449db-8e4e-4c37-804c-7f35470b7b8f req-2e85721c-1f52-4fba-a998-62521ba99452 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Refreshing instance network info cache due to event network-changed-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:08:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6dc449db-8e4e-4c37-804c-7f35470b7b8f req-2e85721c-1f52-4fba-a998-62521ba99452 service nova] Acquiring lock "refresh_cache-83ea4f5e-3381-4561-8bdb-868466b4d49d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:08:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6dc449db-8e4e-4c37-804c-7f35470b7b8f req-2e85721c-1f52-4fba-a998-62521ba99452 service nova] Acquired lock "refresh_cache-83ea4f5e-3381-4561-8bdb-868466b4d49d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:08:31 user nova-compute[72990]: DEBUG nova.network.neutron [req-6dc449db-8e4e-4c37-804c-7f35470b7b8f req-2e85721c-1f52-4fba-a998-62521ba99452 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Refreshing network info cache for port 3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:08:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-6dc449db-8e4e-4c37-804c-7f35470b7b8f req-2e85721c-1f52-4fba-a998-62521ba99452 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Updated VIF entry in instance network info cache for port 3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:08:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-6dc449db-8e4e-4c37-804c-7f35470b7b8f req-2e85721c-1f52-4fba-a998-62521ba99452 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Updating instance_info_cache with network_info: [{"id": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "address": "fa:16:3e:79:f3:1f", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3a4f8d-49", "ovs_interfaceid": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:08:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6dc449db-8e4e-4c37-804c-7f35470b7b8f req-2e85721c-1f52-4fba-a998-62521ba99452 service nova] Releasing lock "refresh_cache-83ea4f5e-3381-4561-8bdb-868466b4d49d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG nova.objects.instance [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lazy-loading 'flavor' on Instance uuid 83ea4f5e-3381-4561-8bdb-868466b4d49d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:33 user nova-compute[72990]: INFO nova.compute.manager [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Attaching volume 5d021670-9042-4341-9596-96af2034ed04 to /dev/vdb
Aug 27 04:08:33 user nova-compute[72990]: DEBUG os_brick.utils [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7c98fc-868b-434f-85c9-f90f456c2892]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[860d8972-c264-4084-bfb7-bead65fa42c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5df0078-1942-465a-bb94-7883b0b76298]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e71b2f-9c81-4bc9-8b6e-538c4755172c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:08:33 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:08:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[715c24ae-20e3-4824-9679-b122f617abfe]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG os_brick.utils [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:08:33 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Updating existing volume attachment record: 11239c69-59c6-43e5-b3b6-f96e7d99a8a2 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:08:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:41 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:08:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:43 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:08:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:08:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:47 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:08:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:47 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:47 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:08:47 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:48 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:49 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:08:49 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:08:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7987MB free_disk=25.007831573486328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance da3f86d1-09e4-4c85-b275-145c86f1aa15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 0206498e-6ec9-4af7-a4bb-ea512b71e4be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 83ea4f5e-3381-4561-8bdb-868466b4d49d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 418f0216-43b8-4437-b1ee-8cbff5830c4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance b0392f8e-364d-450b-84c7-7b3f631a3a58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:08:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:50 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:08:50 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:08:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:08:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:08:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:08:50 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:08:51 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updating instance_info_cache with network_info: [{"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:08:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:08:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:08:51 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:08:51 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:08:51 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:08:51 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:08:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:08:53 user nova-compute[72990]: INFO nova.compute.claims [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Claim successful on node user
Aug 27 04:08:53 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG nova.network.neutron [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:08:53 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:08:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG nova.policy [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5711f5c9c8344de79b246e7eb8661ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a8267a0042a0ad831e7b91889dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:08:53 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Creating image(s)
Aug 27 04:08:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "/opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "/opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk 1073741824" returned: 0 in 0.056s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.224s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG nova.network.neutron [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Successfully created port: 6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Cannot resize image /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Ensure instance console log exists: /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:55 user nova-compute[72990]: DEBUG nova.network.neutron [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Successfully updated port: 6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:08:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "refresh_cache-8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:08:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquired lock "refresh_cache-8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:08:55 user nova-compute[72990]: DEBUG nova.network.neutron [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:08:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-05da806a-6bdf-44c9-b5b1-825513832179 req-bea1e7e8-4c9b-46a7-b1c3-9b5d60f58770 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Received event network-changed-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-05da806a-6bdf-44c9-b5b1-825513832179 req-bea1e7e8-4c9b-46a7-b1c3-9b5d60f58770 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Refreshing instance network info cache due to event network-changed-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:08:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-05da806a-6bdf-44c9-b5b1-825513832179 req-bea1e7e8-4c9b-46a7-b1c3-9b5d60f58770 service nova] Acquiring lock "refresh_cache-8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:08:55 user nova-compute[72990]: DEBUG nova.network.neutron [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.network.neutron [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Updating instance_info_cache with network_info: [{"id": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "address": "fa:16:3e:e9:51:05", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f766b68-0d", "ovs_interfaceid": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Releasing lock "refresh_cache-8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Instance network_info: |[{"id": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "address": "fa:16:3e:e9:51:05", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f766b68-0d", "ovs_interfaceid": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-05da806a-6bdf-44c9-b5b1-825513832179 req-bea1e7e8-4c9b-46a7-b1c3-9b5d60f58770 service nova] Acquired lock "refresh_cache-8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.network.neutron [req-05da806a-6bdf-44c9-b5b1-825513832179 req-bea1e7e8-4c9b-46a7-b1c3-9b5d60f58770 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Refreshing network info cache for port 6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Start _get_guest_xml network_info=[{"id": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "address": "fa:16:3e:e9:51:05", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f766b68-0d", "ovs_interfaceid": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:08:56 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:08:56 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:08:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1859585961',display_name='tempest-AttachVolumeTestJSON-server-1859585961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1859585961',id=45,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqthOOTRdA6D0ha68lyGuRIUkQdWowIedpBt+bSFUR61sjcjpQQYmcLA+C59GnxaZwXTHc+vRL0jq9LAhMALqYppzKE+1+iHD9KCucKfoa2Aes9IICuXr0SwyZtq0JsdQ==',key_name='tempest-keypair-1060503035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d0a8267a0042a0ad831e7b91889dc7',ramdisk_id='',reservation_id='r-e1a1cgx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-698620353',owner_user_name='tempest-AttachVolumeTestJSON-698620353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:08:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5711f5c9c8344de79b246e7eb8661ff2',uuid=8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "address": "fa:16:3e:e9:51:05", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f766b68-0d", "ovs_interfaceid": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converting VIF {"id": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "address": "fa:16:3e:e9:51:05", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f766b68-0d", "ovs_interfaceid": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:51:05,bridge_name='br-int',has_traffic_filtering=True,id=6f766b68-0ddc-407e-974f-ef2ef3c8d1ca,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f766b68-0d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.objects.instance [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:08:56 user nova-compute[72990]:   <uuid>8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8</uuid>
Aug 27 04:08:56 user nova-compute[72990]:   <name>instance-0000002d</name>
Aug 27 04:08:56 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:08:56 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:08:56 user nova-compute[72990]:   <metadata>
Aug 27 04:08:56 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:08:56 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:08:56 user nova-compute[72990]:       <nova:name>tempest-AttachVolumeTestJSON-server-1859585961</nova:name>
Aug 27 04:08:56 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:08:56</nova:creationTime>
Aug 27 04:08:56 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:08:56 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:08:56 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:08:56 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:08:56 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:08:56 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:08:56 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:08:56 user nova-compute[72990]:       <nova:owner>
Aug 27 04:08:56 user nova-compute[72990]:         <nova:user uuid="5711f5c9c8344de79b246e7eb8661ff2">tempest-AttachVolumeTestJSON-698620353-project-member</nova:user>
Aug 27 04:08:56 user nova-compute[72990]:         <nova:project uuid="e2d0a8267a0042a0ad831e7b91889dc7">tempest-AttachVolumeTestJSON-698620353</nova:project>
Aug 27 04:08:56 user nova-compute[72990]:       </nova:owner>
Aug 27 04:08:56 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 04:08:56 user nova-compute[72990]:       <nova:ports>
Aug 27 04:08:56 user nova-compute[72990]:         <nova:port uuid="6f766b68-0ddc-407e-974f-ef2ef3c8d1ca">
Aug 27 04:08:56 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 04:08:56 user nova-compute[72990]:         </nova:port>
Aug 27 04:08:56 user nova-compute[72990]:       </nova:ports>
Aug 27 04:08:56 user nova-compute[72990]:     </nova:instance>
Aug 27 04:08:56 user nova-compute[72990]:   </metadata>
Aug 27 04:08:56 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:08:56 user nova-compute[72990]:     <system>
Aug 27 04:08:56 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:08:56 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:08:56 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:08:56 user nova-compute[72990]:       <entry name="serial">8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8</entry>
Aug 27 04:08:56 user nova-compute[72990]:       <entry name="uuid">8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8</entry>
Aug 27 04:08:56 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:08:56 user nova-compute[72990]:     </system>
Aug 27 04:08:56 user nova-compute[72990]:   </sysinfo>
Aug 27 04:08:56 user nova-compute[72990]:   <os>
Aug 27 04:08:56 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:08:56 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:08:56 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:08:56 user nova-compute[72990]:   </os>
Aug 27 04:08:56 user nova-compute[72990]:   <features>
Aug 27 04:08:56 user nova-compute[72990]:     <acpi/>
Aug 27 04:08:56 user nova-compute[72990]:     <apic/>
Aug 27 04:08:56 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:08:56 user nova-compute[72990]:   </features>
Aug 27 04:08:56 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:08:56 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:08:56 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:08:56 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:08:56 user nova-compute[72990]:   </clock>
Aug 27 04:08:56 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:08:56 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:08:56 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:08:56 user nova-compute[72990]:   </cpu>
Aug 27 04:08:56 user nova-compute[72990]:   <devices>
Aug 27 04:08:56 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:08:56 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:08:56 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk"/>
Aug 27 04:08:56 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:08:56 user nova-compute[72990]:     </disk>
Aug 27 04:08:56 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:08:56 user nova-compute[72990]:       <mac address="fa:16:3e:e9:51:05"/>
Aug 27 04:08:56 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:08:56 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:08:56 user nova-compute[72990]:       <target dev="tap6f766b68-0d"/>
Aug 27 04:08:56 user nova-compute[72990]:     </interface>
Aug 27 04:08:56 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:08:56 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/console.log" append="off"/>
Aug 27 04:08:56 user nova-compute[72990]:     </serial>
Aug 27 04:08:56 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:08:56 user nova-compute[72990]:     <video>
Aug 27 04:08:56 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:08:56 user nova-compute[72990]:     </video>
Aug 27 04:08:56 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:08:56 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:08:56 user nova-compute[72990]:     </rng>
Aug 27 04:08:56 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:08:56 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:08:56 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:08:56 user nova-compute[72990]:     </memballoon>
Aug 27 04:08:56 user nova-compute[72990]:   </devices>
Aug 27 04:08:56 user nova-compute[72990]: </domain>
Aug 27 04:08:56 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:08:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1859585961',display_name='tempest-AttachVolumeTestJSON-server-1859585961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1859585961',id=45,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqthOOTRdA6D0ha68lyGuRIUkQdWowIedpBt+bSFUR61sjcjpQQYmcLA+C59GnxaZwXTHc+vRL0jq9LAhMALqYppzKE+1+iHD9KCucKfoa2Aes9IICuXr0SwyZtq0JsdQ==',key_name='tempest-keypair-1060503035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d0a8267a0042a0ad831e7b91889dc7',ramdisk_id='',reservation_id='r-e1a1cgx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-698620353',owner_user_name='tempest-AttachVolumeTestJSON-698620353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:08:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5711f5c9c8344de79b246e7eb8661ff2',uuid=8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "address": "fa:16:3e:e9:51:05", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f766b68-0d", "ovs_interfaceid": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converting VIF {"id": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "address": "fa:16:3e:e9:51:05", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f766b68-0d", "ovs_interfaceid": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:51:05,bridge_name='br-int',has_traffic_filtering=True,id=6f766b68-0ddc-407e-974f-ef2ef3c8d1ca,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f766b68-0d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG os_vif [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:51:05,bridge_name='br-int',has_traffic_filtering=True,id=6f766b68-0ddc-407e-974f-ef2ef3c8d1ca,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f766b68-0d') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f766b68-0d, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f766b68-0d, col_values=(('external_ids', {'iface-id': '6f766b68-0ddc-407e-974f-ef2ef3c8d1ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:51:05', 'vm-uuid': '8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:56 user nova-compute[72990]: INFO os_vif [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:51:05,bridge_name='br-int',has_traffic_filtering=True,id=6f766b68-0ddc-407e-974f-ef2ef3c8d1ca,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f766b68-0d')
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No VIF found with MAC fa:16:3e:e9:51:05, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.network.neutron [req-05da806a-6bdf-44c9-b5b1-825513832179 req-bea1e7e8-4c9b-46a7-b1c3-9b5d60f58770 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Updated VIF entry in instance network info cache for port 6f766b68-0ddc-407e-974f-ef2ef3c8d1ca. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG nova.network.neutron [req-05da806a-6bdf-44c9-b5b1-825513832179 req-bea1e7e8-4c9b-46a7-b1c3-9b5d60f58770 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Updating instance_info_cache with network_info: [{"id": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "address": "fa:16:3e:e9:51:05", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f766b68-0d", "ovs_interfaceid": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:08:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-05da806a-6bdf-44c9-b5b1-825513832179 req-bea1e7e8-4c9b-46a7-b1c3-9b5d60f58770 service nova] Releasing lock "refresh_cache-8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtXsmQDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:08:57 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:08:57 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:08:57 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[195db942-bbbf-4697-80d8-5734723f5484]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:08:57 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[306b23bc-4172-4c68-a4e9-c0082e59b1aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04] added
Aug 27 04:08:57 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[65329a18-8fbd-4f5b-88bb-869916774ea8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2328b1-6ad0-4ffc-95ca-cbd5e6c7ca06]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtXsmQDi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtXsmQDi" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[37be9cf6-b214-4a8d-8722-da759f1981a8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rtXsmQDi'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4f5584-7420-4ccd-a68e-848e5fa54dab]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed003f1-7db2-4aa5-ba09-f879f87d9454]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:08:57 user nova-compute[72990]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)
Aug 27 04:08:57 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:08:57 user nova-compute[72990]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)
Aug 27 04:08:57 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[440555b7-3e4d-41ec-bc18-6ec13ce0808e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04, portal: 172.16.0.220,3260]
Aug 27 04:08:57 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04, portal: 172.16.0.220,3260] successful.
Aug 27 04:08:57 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d789c6-0120-4af6-901b-e2fb5a36e542]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[685e2a6a-77a1-4407-8bd3-75cbb68bd7c1]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:08:57 user nova-compute[72990]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)
Aug 27 04:08:57 user nova-compute[72990]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 (non-flash)
Aug 27 04:08:57 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:08:57 user nova-compute[72990]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)
Aug 27 04:08:57 user nova-compute[72990]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 (non-flash)
Aug 27 04:08:57 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.037s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[af460f13-1a78-4298-aa27-a983f8d82c2a]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtXsmQDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG nova.compute.manager [req-84d1cfe2-9232-48bf-b2ef-ed64ed1f0583 req-6c84513c-02f6-464c-8d6e-4c8f9f97f378 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Received event network-vif-plugged-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-84d1cfe2-9232-48bf-b2ef-ed64ed1f0583 req-6c84513c-02f6-464c-8d6e-4c8f9f97f378 service nova] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-84d1cfe2-9232-48bf-b2ef-ed64ed1f0583 req-6c84513c-02f6-464c-8d6e-4c8f9f97f378 service nova] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-84d1cfe2-9232-48bf-b2ef-ed64ed1f0583 req-6c84513c-02f6-464c-8d6e-4c8f9f97f378 service nova] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:57 user nova-compute[72990]: DEBUG nova.compute.manager [req-84d1cfe2-9232-48bf-b2ef-ed64ed1f0583 req-6c84513c-02f6-464c-8d6e-4c8f9f97f378 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] No waiting events found dispatching network-vif-plugged-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:08:57 user nova-compute[72990]: WARNING nova.compute.manager [req-84d1cfe2-9232-48bf-b2ef-ed64ed1f0583 req-6c84513c-02f6-464c-8d6e-4c8f9f97f378 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Received unexpected event network-vif-plugged-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca for instance with vm_state building and task_state spawning.
Aug 27 04:08:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:08:58 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:08:58 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '23264663431303864', 'path': '/dev/sdd'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:08:58 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264663431303864', 'path': '/dev/sdd'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:08:58 user nova-compute[72990]: DEBUG nova.objects.instance [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lazy-loading 'flavor' on Instance uuid 83ea4f5e-3381-4561-8bdb-868466b4d49d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:08:58 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:08:58 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:08:58 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 04:08:58 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:08:58 user nova-compute[72990]:   <serial>5d021670-9042-4341-9596-96af2034ed04</serial>
Aug 27 04:08:58 user nova-compute[72990]: </disk>
Aug 27 04:08:58 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] No VIF found with MAC fa:16:3e:79:f3:1f, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ad807430-9af0-4bae-9d5b-f29e032056af tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.141s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109339.9344645, 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:08:59 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] VM Resumed (Lifecycle Event)
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.compute.manager [req-1766b2ba-8eeb-4480-842c-7288a3718c98 req-b4124911-85cb-4b5e-94ba-978a26f39b02 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Received event network-vif-plugged-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1766b2ba-8eeb-4480-842c-7288a3718c98 req-b4124911-85cb-4b5e-94ba-978a26f39b02 service nova] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1766b2ba-8eeb-4480-842c-7288a3718c98 req-b4124911-85cb-4b5e-94ba-978a26f39b02 service nova] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1766b2ba-8eeb-4480-842c-7288a3718c98 req-b4124911-85cb-4b5e-94ba-978a26f39b02 service nova] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.compute.manager [req-1766b2ba-8eeb-4480-842c-7288a3718c98 req-b4124911-85cb-4b5e-94ba-978a26f39b02 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] No waiting events found dispatching network-vif-plugged-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:08:59 user nova-compute[72990]: WARNING nova.compute.manager [req-1766b2ba-8eeb-4480-842c-7288a3718c98 req-b4124911-85cb-4b5e-94ba-978a26f39b02 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Received unexpected event network-vif-plugged-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca for instance with vm_state building and task_state spawning.
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:08:59 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Instance spawned successfully.
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:08:59 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:08:59 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109339.9361129, 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:08:59 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] VM Started (Lifecycle Event)
Aug 27 04:09:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:09:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:09:00 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:09:00 user nova-compute[72990]: INFO nova.compute.manager [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 27 04:09:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:09:00 user nova-compute[72990]: INFO nova.compute.manager [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Took 6.86 seconds to build instance.
Aug 27 04:09:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-264a1a13-4942-4be3-a74b-c1245da8a5c0 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.963s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:01 user nova-compute[72990]: INFO nova.compute.manager [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Detaching volume 5d021670-9042-4341-9596-96af2034ed04
Aug 27 04:09:01 user nova-compute[72990]: INFO nova.virt.block_device [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Attempting to driver detach volume 5d021670-9042-4341-9596-96af2034ed04 from mountpoint /dev/vdb
Aug 27 04:09:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Attempting to detach device vdb from instance 83ea4f5e-3381-4561-8bdb-868466b4d49d from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:09:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:09:01 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:09:01 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 04:09:01 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:09:01 user nova-compute[72990]:   <serial>5d021670-9042-4341-9596-96af2034ed04</serial>
Aug 27 04:09:01 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:09:01 user nova-compute[72990]: </disk>
Aug 27 04:09:01 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:09:01 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Successfully detached device vdb from instance 83ea4f5e-3381-4561-8bdb-868466b4d49d from the persistent domain config.
Aug 27 04:09:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83ea4f5e-3381-4561-8bdb-868466b4d49d from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:09:01 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:09:01 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:09:01 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 04:09:01 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:09:01 user nova-compute[72990]:   <serial>5d021670-9042-4341-9596-96af2034ed04</serial>
Aug 27 04:09:01 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:09:01 user nova-compute[72990]: </disk>
Aug 27 04:09:01 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693109342.2325125, 83ea4f5e-3381-4561-8bdb-868466b4d49d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83ea4f5e-3381-4561-8bdb-868466b4d49d {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:09:02 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Successfully detached device vdb from instance 83ea4f5e-3381-4561-8bdb-868466b4d49d from the live domain config.
Aug 27 04:09:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtXsmQDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:09:02 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34fe517-210a-4b5e-8af8-9ac91d53d3ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3f2cbd-b54a-4b50-8870-a1af554ee358]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:09:02 user nova-compute[72990]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)
Aug 27 04:09:02 user nova-compute[72990]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 (non-flash)
Aug 27 04:09:02 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:09:02 user nova-compute[72990]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)
Aug 27 04:09:02 user nova-compute[72990]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 (non-flash)
Aug 27 04:09:02 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44a3520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04'): ({'sdd'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Removing single pathed devices sdd {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0381729d-ff1f-447f-8098-a4b2015da580]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8b3bf3-c062-49e1-9741-b1d1a3a032bd]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Flushing IO for device /dev/sdd {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[991902e9-5716-4c1e-aa21-31090be1bccc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d336a4d-666d-4a8b-bb02-aa844c051323]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[308a0891-bcb1-40ae-80c6-c24621e4861e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ade2e0-b369-4126-98a4-f56f1d689129]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04, portal: 172.16.0.220,3260]
Aug 27 04:09:02 user nova-compute[72990]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04, portal: 172.16.0.220,3260] successful.
Aug 27 04:09:02 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d021670-9042-4341-9596-96af2034ed04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf3a49f-a7da-4ea7-a7a2-4412076f39f6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] <== disconnect_volume: return (303ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:09:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:09:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:09 user nova-compute[72990]: DEBUG nova.objects.instance [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lazy-loading 'flavor' on Instance uuid 83ea4f5e-3381-4561-8bdb-868466b4d49d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:09:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e65ee771-1957-400e-af44-21593fff4ca4 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.125s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:09:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:09:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:09:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:09:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:09:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:09:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:09:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:09:22 user nova-compute[72990]: INFO nova.compute.claims [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Claim successful on node user
Aug 27 04:09:22 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:09:22 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:09:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:09:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:09:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG nova.policy [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bc7642afe894fea911c5bd6250e436f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672e3e9fbb0844ada56ef6b665212fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:09:23 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Creating image(s)
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "/opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "/opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.200s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.207s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk 1073741824" returned: 0 in 0.061s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:09:23 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:24 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Cannot resize image /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:09:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:09:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Ensure instance console log exists: /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:09:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:24 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Successfully created port: 0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Successfully updated port: 0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "refresh_cache-fbba3f29-4b57-43c8-aecd-27e8d3d85c44" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquired lock "refresh_cache-fbba3f29-4b57-43c8-aecd-27e8d3d85c44" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-a7c3eb5a-b241-4227-a75d-2ce40ddc2991 req-f3d781a9-155b-4d5c-945a-199712d4a554 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Received event network-changed-0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-a7c3eb5a-b241-4227-a75d-2ce40ddc2991 req-f3d781a9-155b-4d5c-945a-199712d4a554 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Refreshing instance network info cache due to event network-changed-0498f2e1-b488-4c8b-90f6-51343e41b0df. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a7c3eb5a-b241-4227-a75d-2ce40ddc2991 req-f3d781a9-155b-4d5c-945a-199712d4a554 service nova] Acquiring lock "refresh_cache-fbba3f29-4b57-43c8-aecd-27e8d3d85c44" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.network.neutron [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Updating instance_info_cache with network_info: [{"id": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "address": "fa:16:3e:05:61:fa", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0498f2e1-b4", "ovs_interfaceid": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Releasing lock "refresh_cache-fbba3f29-4b57-43c8-aecd-27e8d3d85c44" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Instance network_info: |[{"id": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "address": "fa:16:3e:05:61:fa", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0498f2e1-b4", "ovs_interfaceid": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a7c3eb5a-b241-4227-a75d-2ce40ddc2991 req-f3d781a9-155b-4d5c-945a-199712d4a554 service nova] Acquired lock "refresh_cache-fbba3f29-4b57-43c8-aecd-27e8d3d85c44" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.network.neutron [req-a7c3eb5a-b241-4227-a75d-2ce40ddc2991 req-f3d781a9-155b-4d5c-945a-199712d4a554 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Refreshing network info cache for port 0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Start _get_guest_xml network_info=[{"id": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "address": "fa:16:3e:05:61:fa", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0498f2e1-b4", "ovs_interfaceid": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:09:25 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:09:25 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1017785174',display_name='tempest-VolumesSnapshotTestJSON-instance-1017785174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1017785174',id=46,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMRtRL7Ih67Hz0tHnMbo0u4g7Lev/1zGTg8xsuEytPXKYOyMTulaPbHa0tvNM3BfWMIFmM63jqI4Kg+CO3KAsv2k+bf2FnKsPsAs65s1HA9DcaYtPTV38WFMCTM/7Fr0w==',key_name='tempest-keypair-1774246484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='672e3e9fbb0844ada56ef6b665212fb0',ramdisk_id='',reservation_id='r-v9bh09fp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1409906536',owner_user_name='tempest-VolumesSnapshotTestJSON-1409906536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bc7642afe894fea911c5bd6250e436f',uuid=fbba3f29-4b57-43c8-aecd-27e8d3d85c44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "address": "fa:16:3e:05:61:fa", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0498f2e1-b4", "ovs_interfaceid": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Converting VIF {"id": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "address": "fa:16:3e:05:61:fa", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0498f2e1-b4", "ovs_interfaceid": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:61:fa,bridge_name='br-int',has_traffic_filtering=True,id=0498f2e1-b488-4c8b-90f6-51343e41b0df,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0498f2e1-b4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lazy-loading 'pci_devices' on Instance uuid fbba3f29-4b57-43c8-aecd-27e8d3d85c44 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:09:25 user nova-compute[72990]:   <uuid>fbba3f29-4b57-43c8-aecd-27e8d3d85c44</uuid>
Aug 27 04:09:25 user nova-compute[72990]:   <name>instance-0000002e</name>
Aug 27 04:09:25 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:09:25 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:09:25 user nova-compute[72990]:   <metadata>
Aug 27 04:09:25 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:09:25 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:09:25 user nova-compute[72990]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1017785174</nova:name>
Aug 27 04:09:25 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:09:25</nova:creationTime>
Aug 27 04:09:25 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:09:25 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:09:25 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:09:25 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:09:25 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:09:25 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:09:25 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:09:25 user nova-compute[72990]:       <nova:owner>
Aug 27 04:09:25 user nova-compute[72990]:         <nova:user uuid="0bc7642afe894fea911c5bd6250e436f">tempest-VolumesSnapshotTestJSON-1409906536-project-member</nova:user>
Aug 27 04:09:25 user nova-compute[72990]:         <nova:project uuid="672e3e9fbb0844ada56ef6b665212fb0">tempest-VolumesSnapshotTestJSON-1409906536</nova:project>
Aug 27 04:09:25 user nova-compute[72990]:       </nova:owner>
Aug 27 04:09:25 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 04:09:25 user nova-compute[72990]:       <nova:ports>
Aug 27 04:09:25 user nova-compute[72990]:         <nova:port uuid="0498f2e1-b488-4c8b-90f6-51343e41b0df">
Aug 27 04:09:25 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 04:09:25 user nova-compute[72990]:         </nova:port>
Aug 27 04:09:25 user nova-compute[72990]:       </nova:ports>
Aug 27 04:09:25 user nova-compute[72990]:     </nova:instance>
Aug 27 04:09:25 user nova-compute[72990]:   </metadata>
Aug 27 04:09:25 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:09:25 user nova-compute[72990]:     <system>
Aug 27 04:09:25 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:09:25 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:09:25 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:09:25 user nova-compute[72990]:       <entry name="serial">fbba3f29-4b57-43c8-aecd-27e8d3d85c44</entry>
Aug 27 04:09:25 user nova-compute[72990]:       <entry name="uuid">fbba3f29-4b57-43c8-aecd-27e8d3d85c44</entry>
Aug 27 04:09:25 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:09:25 user nova-compute[72990]:     </system>
Aug 27 04:09:25 user nova-compute[72990]:   </sysinfo>
Aug 27 04:09:25 user nova-compute[72990]:   <os>
Aug 27 04:09:25 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:09:25 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:09:25 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:09:25 user nova-compute[72990]:   </os>
Aug 27 04:09:25 user nova-compute[72990]:   <features>
Aug 27 04:09:25 user nova-compute[72990]:     <acpi/>
Aug 27 04:09:25 user nova-compute[72990]:     <apic/>
Aug 27 04:09:25 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:09:25 user nova-compute[72990]:   </features>
Aug 27 04:09:25 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:09:25 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:09:25 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:09:25 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:09:25 user nova-compute[72990]:   </clock>
Aug 27 04:09:25 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:09:25 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:09:25 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:09:25 user nova-compute[72990]:   </cpu>
Aug 27 04:09:25 user nova-compute[72990]:   <devices>
Aug 27 04:09:25 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:09:25 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:09:25 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk"/>
Aug 27 04:09:25 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:09:25 user nova-compute[72990]:     </disk>
Aug 27 04:09:25 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:09:25 user nova-compute[72990]:       <mac address="fa:16:3e:05:61:fa"/>
Aug 27 04:09:25 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:09:25 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:09:25 user nova-compute[72990]:       <target dev="tap0498f2e1-b4"/>
Aug 27 04:09:25 user nova-compute[72990]:     </interface>
Aug 27 04:09:25 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:09:25 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/console.log" append="off"/>
Aug 27 04:09:25 user nova-compute[72990]:     </serial>
Aug 27 04:09:25 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:09:25 user nova-compute[72990]:     <video>
Aug 27 04:09:25 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:09:25 user nova-compute[72990]:     </video>
Aug 27 04:09:25 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:09:25 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:09:25 user nova-compute[72990]:     </rng>
Aug 27 04:09:25 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:09:25 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:09:25 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:09:25 user nova-compute[72990]:     </memballoon>
Aug 27 04:09:25 user nova-compute[72990]:   </devices>
Aug 27 04:09:25 user nova-compute[72990]: </domain>
Aug 27 04:09:25 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1017785174',display_name='tempest-VolumesSnapshotTestJSON-instance-1017785174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1017785174',id=46,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMRtRL7Ih67Hz0tHnMbo0u4g7Lev/1zGTg8xsuEytPXKYOyMTulaPbHa0tvNM3BfWMIFmM63jqI4Kg+CO3KAsv2k+bf2FnKsPsAs65s1HA9DcaYtPTV38WFMCTM/7Fr0w==',key_name='tempest-keypair-1774246484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='672e3e9fbb0844ada56ef6b665212fb0',ramdisk_id='',reservation_id='r-v9bh09fp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1409906536',owner_user_name='tempest-VolumesSnapshotTestJSON-1409906536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bc7642afe894fea911c5bd6250e436f',uuid=fbba3f29-4b57-43c8-aecd-27e8d3d85c44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "address": "fa:16:3e:05:61:fa", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0498f2e1-b4", "ovs_interfaceid": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Converting VIF {"id": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "address": "fa:16:3e:05:61:fa", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0498f2e1-b4", "ovs_interfaceid": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:61:fa,bridge_name='br-int',has_traffic_filtering=True,id=0498f2e1-b488-4c8b-90f6-51343e41b0df,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0498f2e1-b4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG os_vif [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:61:fa,bridge_name='br-int',has_traffic_filtering=True,id=0498f2e1-b488-4c8b-90f6-51343e41b0df,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0498f2e1-b4') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0498f2e1-b4, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0498f2e1-b4, col_values=(('external_ids', {'iface-id': '0498f2e1-b488-4c8b-90f6-51343e41b0df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:61:fa', 'vm-uuid': 'fbba3f29-4b57-43c8-aecd-27e8d3d85c44'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:25 user nova-compute[72990]: INFO os_vif [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:61:fa,bridge_name='br-int',has_traffic_filtering=True,id=0498f2e1-b488-4c8b-90f6-51343e41b0df,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0498f2e1-b4')
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] No VIF found with MAC fa:16:3e:05:61:fa, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.network.neutron [req-a7c3eb5a-b241-4227-a75d-2ce40ddc2991 req-f3d781a9-155b-4d5c-945a-199712d4a554 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Updated VIF entry in instance network info cache for port 0498f2e1-b488-4c8b-90f6-51343e41b0df. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:09:25 user nova-compute[72990]: DEBUG nova.network.neutron [req-a7c3eb5a-b241-4227-a75d-2ce40ddc2991 req-f3d781a9-155b-4d5c-945a-199712d4a554 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Updating instance_info_cache with network_info: [{"id": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "address": "fa:16:3e:05:61:fa", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0498f2e1-b4", "ovs_interfaceid": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:09:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a7c3eb5a-b241-4227-a75d-2ce40ddc2991 req-f3d781a9-155b-4d5c-945a-199712d4a554 service nova] Releasing lock "refresh_cache-fbba3f29-4b57-43c8-aecd-27e8d3d85c44" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:09:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-a2347ecf-27d1-419a-bf1d-9227b959ca35 req-141f5bcc-9797-44e6-905a-0299be44de68 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Received event network-vif-plugged-0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a2347ecf-27d1-419a-bf1d-9227b959ca35 req-141f5bcc-9797-44e6-905a-0299be44de68 service nova] Acquiring lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a2347ecf-27d1-419a-bf1d-9227b959ca35 req-141f5bcc-9797-44e6-905a-0299be44de68 service nova] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a2347ecf-27d1-419a-bf1d-9227b959ca35 req-141f5bcc-9797-44e6-905a-0299be44de68 service nova] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-a2347ecf-27d1-419a-bf1d-9227b959ca35 req-141f5bcc-9797-44e6-905a-0299be44de68 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] No waiting events found dispatching network-vif-plugged-0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:09:27 user nova-compute[72990]: WARNING nova.compute.manager [req-a2347ecf-27d1-419a-bf1d-9227b959ca35 req-141f5bcc-9797-44e6-905a-0299be44de68 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Received unexpected event network-vif-plugged-0498f2e1-b488-4c8b-90f6-51343e41b0df for instance with vm_state building and task_state spawning.
Aug 27 04:09:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109369.0442822, fbba3f29-4b57-43c8-aecd-27e8d3d85c44 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:09:29 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] VM Resumed (Lifecycle Event)
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:09:29 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Instance spawned successfully.
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:09:29 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109369.0461476, fbba3f29-4b57-43c8-aecd-27e8d3d85c44 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:09:29 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] VM Started (Lifecycle Event)
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:09:29 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:09:29 user nova-compute[72990]: INFO nova.compute.manager [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:09:29 user nova-compute[72990]: INFO nova.compute.manager [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Took 6.64 seconds to build instance.
Aug 27 04:09:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2c00377f-04a3-4f8d-82ce-b07946968c0d tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.749s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-b73c7ff3-bb08-4cae-aaf1-c76dedfe345c req-df82b1cc-4ecf-4dab-954c-a190fd34f69b service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Received event network-vif-plugged-0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b73c7ff3-bb08-4cae-aaf1-c76dedfe345c req-df82b1cc-4ecf-4dab-954c-a190fd34f69b service nova] Acquiring lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b73c7ff3-bb08-4cae-aaf1-c76dedfe345c req-df82b1cc-4ecf-4dab-954c-a190fd34f69b service nova] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b73c7ff3-bb08-4cae-aaf1-c76dedfe345c req-df82b1cc-4ecf-4dab-954c-a190fd34f69b service nova] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-b73c7ff3-bb08-4cae-aaf1-c76dedfe345c req-df82b1cc-4ecf-4dab-954c-a190fd34f69b service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] No waiting events found dispatching network-vif-plugged-0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:09:29 user nova-compute[72990]: WARNING nova.compute.manager [req-b73c7ff3-bb08-4cae-aaf1-c76dedfe345c req-df82b1cc-4ecf-4dab-954c-a190fd34f69b service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Received unexpected event network-vif-plugged-0498f2e1-b488-4c8b-90f6-51343e41b0df for instance with vm_state active and task_state None.
Aug 27 04:09:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "213d93d2-14b9-47fc-afb2-568545c6214c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "213d93d2-14b9-47fc-afb2-568545c6214c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:09:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:37 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:09:37 user nova-compute[72990]: INFO nova.compute.claims [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Claim successful on node user
Aug 27 04:09:38 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG nova.network.neutron [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:09:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:09:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG nova.policy [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12f4f79d69a147568e4e0a44ffbf6591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161e68b849ab44c1bd68f134d620add6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG nova.compute.manager [req-def33c0d-4f4d-4fa2-9e7b-12a5dc65275f req-d2648be0-63d0-4513-85e5-c7467ffa6481 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Received event network-changed-18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG nova.compute.manager [req-def33c0d-4f4d-4fa2-9e7b-12a5dc65275f req-d2648be0-63d0-4513-85e5-c7467ffa6481 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Refreshing instance network info cache due to event network-changed-18f910ad-c772-4a55-bb31-6e102075aaa7. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-def33c0d-4f4d-4fa2-9e7b-12a5dc65275f req-d2648be0-63d0-4513-85e5-c7467ffa6481 service nova] Acquiring lock "refresh_cache-418f0216-43b8-4437-b1ee-8cbff5830c4e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-def33c0d-4f4d-4fa2-9e7b-12a5dc65275f req-d2648be0-63d0-4513-85e5-c7467ffa6481 service nova] Acquired lock "refresh_cache-418f0216-43b8-4437-b1ee-8cbff5830c4e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG nova.network.neutron [req-def33c0d-4f4d-4fa2-9e7b-12a5dc65275f req-d2648be0-63d0-4513-85e5-c7467ffa6481 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Refreshing network info cache for port 18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:09:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Creating image(s)
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "/opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "/opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "/opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.196s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk 1073741824" returned: 0 in 0.060s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.210s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Cannot resize image /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Ensure instance console log exists: /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "418f0216-43b8-4437-b1ee-8cbff5830c4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:39 user nova-compute[72990]: INFO nova.compute.manager [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Terminating instance
Aug 27 04:09:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG nova.network.neutron [req-def33c0d-4f4d-4fa2-9e7b-12a5dc65275f req-d2648be0-63d0-4513-85e5-c7467ffa6481 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Updated VIF entry in instance network info cache for port 18f910ad-c772-4a55-bb31-6e102075aaa7. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG nova.network.neutron [req-def33c0d-4f4d-4fa2-9e7b-12a5dc65275f req-d2648be0-63d0-4513-85e5-c7467ffa6481 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Updating instance_info_cache with network_info: [{"id": "18f910ad-c772-4a55-bb31-6e102075aaa7", "address": "fa:16:3e:4e:ad:c8", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f910ad-c7", "ovs_interfaceid": "18f910ad-c772-4a55-bb31-6e102075aaa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-def33c0d-4f4d-4fa2-9e7b-12a5dc65275f req-d2648be0-63d0-4513-85e5-c7467ffa6481 service nova] Releasing lock "refresh_cache-418f0216-43b8-4437-b1ee-8cbff5830c4e" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG nova.network.neutron [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Successfully created port: 140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-5981892e-9936-4260-9e88-f54ca7d38192 req-dd5b54ab-9b13-4331-ad7d-29037620a4f5 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Received event network-vif-unplugged-18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5981892e-9936-4260-9e88-f54ca7d38192 req-dd5b54ab-9b13-4331-ad7d-29037620a4f5 service nova] Acquiring lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5981892e-9936-4260-9e88-f54ca7d38192 req-dd5b54ab-9b13-4331-ad7d-29037620a4f5 service nova] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5981892e-9936-4260-9e88-f54ca7d38192 req-dd5b54ab-9b13-4331-ad7d-29037620a4f5 service nova] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-5981892e-9936-4260-9e88-f54ca7d38192 req-dd5b54ab-9b13-4331-ad7d-29037620a4f5 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] No waiting events found dispatching network-vif-unplugged-18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-5981892e-9936-4260-9e88-f54ca7d38192 req-dd5b54ab-9b13-4331-ad7d-29037620a4f5 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Received event network-vif-unplugged-18f910ad-c772-4a55-bb31-6e102075aaa7 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:09:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Instance destroyed successfully.
Aug 27 04:09:40 user nova-compute[72990]: DEBUG nova.objects.instance [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lazy-loading 'resources' on Instance uuid 418f0216-43b8-4437-b1ee-8cbff5830c4e {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1929439534',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1929439534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1929439534',id=43,image_ref='d32b23e6-ff6e-45fb-aa8b-7538aa420613',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCL21EifoDTk77ptq71XyPAyTP9QQaW8fAvHPB5edMVRrDn/LvTTdt31MCHareajPbv6WW8lKmLozmeSF1s4zisMeiqtzW68zwp4AH0gpV7L1sXMT9dnrNewt0MaP9eKWA==',key_name='tempest-keypair-1168611090',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:08:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-ev7pcb29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1834919775',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf3112e616344af7873a50d134260637',uuid=418f0216-43b8-4437-b1ee-8cbff5830c4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18f910ad-c772-4a55-bb31-6e102075aaa7", "address": "fa:16:3e:4e:ad:c8", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f910ad-c7", "ovs_interfaceid": "18f910ad-c772-4a55-bb31-6e102075aaa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "18f910ad-c772-4a55-bb31-6e102075aaa7", "address": "fa:16:3e:4e:ad:c8", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f910ad-c7", "ovs_interfaceid": "18f910ad-c772-4a55-bb31-6e102075aaa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ad:c8,bridge_name='br-int',has_traffic_filtering=True,id=18f910ad-c772-4a55-bb31-6e102075aaa7,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f910ad-c7') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_vif [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ad:c8,bridge_name='br-int',has_traffic_filtering=True,id=18f910ad-c772-4a55-bb31-6e102075aaa7,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f910ad-c7') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18f910ad-c7, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:09:40 user nova-compute[72990]: INFO os_vif [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ad:c8,bridge_name='br-int',has_traffic_filtering=True,id=18f910ad-c772-4a55-bb31-6e102075aaa7,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f910ad-c7')
Aug 27 04:09:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwPxCtDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:09:40 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85de33d-0dad-483b-b5c1-b7906549e914]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57dbe97-5171-487a-9b16-1295d38dcc5a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:09:40 user nova-compute[72990]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)
Aug 27 04:09:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:09:40 user nova-compute[72990]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 (non-flash)
Aug 27 04:09:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f41617e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[514b6499-281b-49e4-919d-0bd059b3af3b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2576ba-0674-4e0b-af86-e8136a36b089]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe16b09-fdc0-4fa8-b71c-e2ed059009f0]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d411c384-56c0-4563-a8c0-942e7136f7e3]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d4137de6', '/dev/disk/by-id/scsi-1SCST_BIOd4137de6-5fbda6b48a454872', '/dev/disk/by-id/scsi-23566626461366234') {{(pid=84652) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3efe98-2628-4542-99ae-8a586d97babd]: (4, None) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c800a1c4-f556-488f-9ea4-f73d6377e4e3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc5d01d-4f17-41ea-aaf4-05241d70b6a8]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0, portal: 172.16.0.220,3260]
Aug 27 04:09:40 user nova-compute[72990]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0, portal: 172.16.0.220,3260] successful.
Aug 27 04:09:40 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcabd81a-47f9-4e47-8518-adb7d5c536d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[47563833-3653-4448-961d-e1399ed8c4d6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== disconnect_volume: return (303ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:09:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Deleting instance files /opt/stack/data/nova/instances/418f0216-43b8-4437-b1ee-8cbff5830c4e_del
Aug 27 04:09:40 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Deletion of /opt/stack/data/nova/instances/418f0216-43b8-4437-b1ee-8cbff5830c4e_del complete
Aug 27 04:09:40 user nova-compute[72990]: INFO nova.compute.manager [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 27 04:09:40 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:09:40 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:09:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Successfully updated port: 140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:09:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "refresh_cache-213d93d2-14b9-47fc-afb2-568545c6214c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:09:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquired lock "refresh_cache-213d93d2-14b9-47fc-afb2-568545c6214c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:09:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:09:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.network.neutron [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Updating instance_info_cache with network_info: [{"id": "140b5171-14a7-4b11-9b01-a9badaa4654b", "address": "fa:16:3e:cd:2e:b9", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140b5171-14", "ovs_interfaceid": "140b5171-14a7-4b11-9b01-a9badaa4654b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Received event network-vif-plugged-18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] Acquiring lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] No waiting events found dispatching network-vif-plugged-18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:09:42 user nova-compute[72990]: WARNING nova.compute.manager [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Received unexpected event network-vif-plugged-18f910ad-c772-4a55-bb31-6e102075aaa7 for instance with vm_state active and task_state deleting.
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Received event network-changed-140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.compute.manager [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Refreshing instance network info cache due to event network-changed-140b5171-14a7-4b11-9b01-a9badaa4654b. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] Acquiring lock "refresh_cache-213d93d2-14b9-47fc-afb2-568545c6214c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:09:42 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Took 1.41 seconds to deallocate network for instance.
Aug 27 04:09:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Releasing lock "refresh_cache-213d93d2-14b9-47fc-afb2-568545c6214c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Instance network_info: |[{"id": "140b5171-14a7-4b11-9b01-a9badaa4654b", "address": "fa:16:3e:cd:2e:b9", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140b5171-14", "ovs_interfaceid": "140b5171-14a7-4b11-9b01-a9badaa4654b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] Acquired lock "refresh_cache-213d93d2-14b9-47fc-afb2-568545c6214c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.network.neutron [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Refreshing network info cache for port 140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Start _get_guest_xml network_info=[{"id": "140b5171-14a7-4b11-9b01-a9badaa4654b", "address": "fa:16:3e:cd:2e:b9", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140b5171-14", "ovs_interfaceid": "140b5171-14a7-4b11-9b01-a9badaa4654b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:09:42 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:09:42 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:09:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-887340108',display_name='tempest-VolumesActionsTest-instance-887340108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-887340108',id=47,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='161e68b849ab44c1bd68f134d620add6',ramdisk_id='',reservation_id='r-tgk0gw5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1193624458',owner_user_name='tempest-VolumesActionsTest-1193624458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:09:38Z,user_data=None,user_id='12f4f79d69a147568e4e0a44ffbf6591',uuid=213d93d2-14b9-47fc-afb2-568545c6214c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "140b5171-14a7-4b11-9b01-a9badaa4654b", "address": "fa:16:3e:cd:2e:b9", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140b5171-14", "ovs_interfaceid": "140b5171-14a7-4b11-9b01-a9badaa4654b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Converting VIF {"id": "140b5171-14a7-4b11-9b01-a9badaa4654b", "address": "fa:16:3e:cd:2e:b9", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140b5171-14", "ovs_interfaceid": "140b5171-14a7-4b11-9b01-a9badaa4654b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=140b5171-14a7-4b11-9b01-a9badaa4654b,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140b5171-14') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.objects.instance [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lazy-loading 'pci_devices' on Instance uuid 213d93d2-14b9-47fc-afb2-568545c6214c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:09:42 user nova-compute[72990]:   <uuid>213d93d2-14b9-47fc-afb2-568545c6214c</uuid>
Aug 27 04:09:42 user nova-compute[72990]:   <name>instance-0000002f</name>
Aug 27 04:09:42 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:09:42 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:09:42 user nova-compute[72990]:   <metadata>
Aug 27 04:09:42 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:09:42 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:09:42 user nova-compute[72990]:       <nova:name>tempest-VolumesActionsTest-instance-887340108</nova:name>
Aug 27 04:09:42 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:09:42</nova:creationTime>
Aug 27 04:09:42 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:09:42 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:09:42 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:09:42 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:09:42 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:09:42 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:09:42 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:09:42 user nova-compute[72990]:       <nova:owner>
Aug 27 04:09:42 user nova-compute[72990]:         <nova:user uuid="12f4f79d69a147568e4e0a44ffbf6591">tempest-VolumesActionsTest-1193624458-project-member</nova:user>
Aug 27 04:09:42 user nova-compute[72990]:         <nova:project uuid="161e68b849ab44c1bd68f134d620add6">tempest-VolumesActionsTest-1193624458</nova:project>
Aug 27 04:09:42 user nova-compute[72990]:       </nova:owner>
Aug 27 04:09:42 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 04:09:42 user nova-compute[72990]:       <nova:ports>
Aug 27 04:09:42 user nova-compute[72990]:         <nova:port uuid="140b5171-14a7-4b11-9b01-a9badaa4654b">
Aug 27 04:09:42 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 04:09:42 user nova-compute[72990]:         </nova:port>
Aug 27 04:09:42 user nova-compute[72990]:       </nova:ports>
Aug 27 04:09:42 user nova-compute[72990]:     </nova:instance>
Aug 27 04:09:42 user nova-compute[72990]:   </metadata>
Aug 27 04:09:42 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:09:42 user nova-compute[72990]:     <system>
Aug 27 04:09:42 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:09:42 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:09:42 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:09:42 user nova-compute[72990]:       <entry name="serial">213d93d2-14b9-47fc-afb2-568545c6214c</entry>
Aug 27 04:09:42 user nova-compute[72990]:       <entry name="uuid">213d93d2-14b9-47fc-afb2-568545c6214c</entry>
Aug 27 04:09:42 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:09:42 user nova-compute[72990]:     </system>
Aug 27 04:09:42 user nova-compute[72990]:   </sysinfo>
Aug 27 04:09:42 user nova-compute[72990]:   <os>
Aug 27 04:09:42 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:09:42 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:09:42 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:09:42 user nova-compute[72990]:   </os>
Aug 27 04:09:42 user nova-compute[72990]:   <features>
Aug 27 04:09:42 user nova-compute[72990]:     <acpi/>
Aug 27 04:09:42 user nova-compute[72990]:     <apic/>
Aug 27 04:09:42 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:09:42 user nova-compute[72990]:   </features>
Aug 27 04:09:42 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:09:42 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:09:42 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:09:42 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:09:42 user nova-compute[72990]:   </clock>
Aug 27 04:09:42 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:09:42 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:09:42 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:09:42 user nova-compute[72990]:   </cpu>
Aug 27 04:09:42 user nova-compute[72990]:   <devices>
Aug 27 04:09:42 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:09:42 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:09:42 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk"/>
Aug 27 04:09:42 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:09:42 user nova-compute[72990]:     </disk>
Aug 27 04:09:42 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:09:42 user nova-compute[72990]:       <mac address="fa:16:3e:cd:2e:b9"/>
Aug 27 04:09:42 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:09:42 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:09:42 user nova-compute[72990]:       <target dev="tap140b5171-14"/>
Aug 27 04:09:42 user nova-compute[72990]:     </interface>
Aug 27 04:09:42 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:09:42 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/console.log" append="off"/>
Aug 27 04:09:42 user nova-compute[72990]:     </serial>
Aug 27 04:09:42 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:09:42 user nova-compute[72990]:     <video>
Aug 27 04:09:42 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:09:42 user nova-compute[72990]:     </video>
Aug 27 04:09:42 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:09:42 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:09:42 user nova-compute[72990]:     </rng>
Aug 27 04:09:42 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:09:42 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:09:42 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:09:42 user nova-compute[72990]:     </memballoon>
Aug 27 04:09:42 user nova-compute[72990]:   </devices>
Aug 27 04:09:42 user nova-compute[72990]: </domain>
Aug 27 04:09:42 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:09:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-887340108',display_name='tempest-VolumesActionsTest-instance-887340108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-887340108',id=47,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='161e68b849ab44c1bd68f134d620add6',ramdisk_id='',reservation_id='r-tgk0gw5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1193624458',owner_user_name='tempest-VolumesActionsTest-1193624458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:09:38Z,user_data=None,user_id='12f4f79d69a147568e4e0a44ffbf6591',uuid=213d93d2-14b9-47fc-afb2-568545c6214c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "140b5171-14a7-4b11-9b01-a9badaa4654b", "address": "fa:16:3e:cd:2e:b9", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140b5171-14", "ovs_interfaceid": "140b5171-14a7-4b11-9b01-a9badaa4654b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Converting VIF {"id": "140b5171-14a7-4b11-9b01-a9badaa4654b", "address": "fa:16:3e:cd:2e:b9", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140b5171-14", "ovs_interfaceid": "140b5171-14a7-4b11-9b01-a9badaa4654b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=140b5171-14a7-4b11-9b01-a9badaa4654b,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140b5171-14') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG os_vif [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=140b5171-14a7-4b11-9b01-a9badaa4654b,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140b5171-14') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap140b5171-14, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap140b5171-14, col_values=(('external_ids', {'iface-id': '140b5171-14a7-4b11-9b01-a9badaa4654b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:2e:b9', 'vm-uuid': '213d93d2-14b9-47fc-afb2-568545c6214c'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:42 user nova-compute[72990]: INFO os_vif [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=140b5171-14a7-4b11-9b01-a9badaa4654b,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140b5171-14')
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] No VIF found with MAC fa:16:3e:cd:2e:b9, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.network.neutron [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Updated VIF entry in instance network info cache for port 140b5171-14a7-4b11-9b01-a9badaa4654b. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG nova.network.neutron [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Updating instance_info_cache with network_info: [{"id": "140b5171-14a7-4b11-9b01-a9badaa4654b", "address": "fa:16:3e:cd:2e:b9", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140b5171-14", "ovs_interfaceid": "140b5171-14a7-4b11-9b01-a9badaa4654b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:09:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8c2f5515-0d8b-4a52-8e56-f3de3a91f4a5 req-9917bea7-5da2-4d4c-8f5d-b7740e732c87 service nova] Releasing lock "refresh_cache-213d93d2-14b9-47fc-afb2-568545c6214c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:09:43 user nova-compute[72990]: INFO nova.compute.manager [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Took 0.88 seconds to detach 1 volumes for instance.
Aug 27 04:09:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Deleting volume: bcabd81a-47f9-4e47-8518-adb7d5c536d0 {{(pid=72990) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 04:09:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:43 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:09:43 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:09:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:43 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Deleted allocations for instance 418f0216-43b8-4437-b1ee-8cbff5830c4e
Aug 27 04:09:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a011ac8c-3d0c-4190-b2ba-425916630bc2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "418f0216-43b8-4437-b1ee-8cbff5830c4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.082s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-ead6dba0-5a4e-4c1f-a949-2fbd52be3238 req-894c4aa0-8fa4-4a15-a3b3-9d50d15e4698 service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Received event network-vif-plugged-140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ead6dba0-5a4e-4c1f-a949-2fbd52be3238 req-894c4aa0-8fa4-4a15-a3b3-9d50d15e4698 service nova] Acquiring lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ead6dba0-5a4e-4c1f-a949-2fbd52be3238 req-894c4aa0-8fa4-4a15-a3b3-9d50d15e4698 service nova] Lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ead6dba0-5a4e-4c1f-a949-2fbd52be3238 req-894c4aa0-8fa4-4a15-a3b3-9d50d15e4698 service nova] Lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-ead6dba0-5a4e-4c1f-a949-2fbd52be3238 req-894c4aa0-8fa4-4a15-a3b3-9d50d15e4698 service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] No waiting events found dispatching network-vif-plugged-140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:09:44 user nova-compute[72990]: WARNING nova.compute.manager [req-ead6dba0-5a4e-4c1f-a949-2fbd52be3238 req-894c4aa0-8fa4-4a15-a3b3-9d50d15e4698 service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Received unexpected event network-vif-plugged-140b5171-14a7-4b11-9b01-a9badaa4654b for instance with vm_state building and task_state spawning.
Aug 27 04:09:44 user nova-compute[72990]: DEBUG nova.compute.manager [req-bd4addbe-49f2-4082-99d9-0c089bd544c2 req-868e26b5-7029-4323-8c7b-80f60cf4486d service nova] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Received event network-vif-deleted-18f910ad-c772-4a55-bb31-6e102075aaa7 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:45 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:09:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:09:45 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109385.9820666, 213d93d2-14b9-47fc-afb2-568545c6214c => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:09:45 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] VM Resumed (Lifecycle Event)
Aug 27 04:09:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:09:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:09:45 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Instance spawned successfully.
Aug 27 04:09:45 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:09:46 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109385.9831362, 213d93d2-14b9-47fc-afb2-568545c6214c => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:09:46 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] VM Started (Lifecycle Event)
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:09:46 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:09:46 user nova-compute[72990]: INFO nova.compute.manager [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Took 7.66 seconds to spawn the instance on the hypervisor.
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-0b979d6d-a30a-41ed-8657-b9a77024f027 req-67f33763-d952-4f0d-b807-22a101008b2c service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Received event network-vif-plugged-140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0b979d6d-a30a-41ed-8657-b9a77024f027 req-67f33763-d952-4f0d-b807-22a101008b2c service nova] Acquiring lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0b979d6d-a30a-41ed-8657-b9a77024f027 req-67f33763-d952-4f0d-b807-22a101008b2c service nova] Lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0b979d6d-a30a-41ed-8657-b9a77024f027 req-67f33763-d952-4f0d-b807-22a101008b2c service nova] Lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-0b979d6d-a30a-41ed-8657-b9a77024f027 req-67f33763-d952-4f0d-b807-22a101008b2c service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] No waiting events found dispatching network-vif-plugged-140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:09:46 user nova-compute[72990]: WARNING nova.compute.manager [req-0b979d6d-a30a-41ed-8657-b9a77024f027 req-67f33763-d952-4f0d-b807-22a101008b2c service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Received unexpected event network-vif-plugged-140b5171-14a7-4b11-9b01-a9badaa4654b for instance with vm_state building and task_state spawning.
Aug 27 04:09:46 user nova-compute[72990]: INFO nova.compute.manager [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Took 8.53 seconds to build instance.
Aug 27 04:09:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-226796f5-5c68-43e0-b9e9-ca51f9938d38 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "213d93d2-14b9-47fc-afb2-568545c6214c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.624s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:48 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:09:49 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:09:49 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:09:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:49 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:09:49 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:09:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3fe0353-8f19-4173-b259-f03572338059 req-1f7451a3-19db-4404-835d-40c4c3871a56 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Received event network-changed-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG nova.compute.manager [req-a3fe0353-8f19-4173-b259-f03572338059 req-1f7451a3-19db-4404-835d-40c4c3871a56 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Refreshing instance network info cache due to event network-changed-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3fe0353-8f19-4173-b259-f03572338059 req-1f7451a3-19db-4404-835d-40c4c3871a56 service nova] Acquiring lock "refresh_cache-83ea4f5e-3381-4561-8bdb-868466b4d49d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3fe0353-8f19-4173-b259-f03572338059 req-1f7451a3-19db-4404-835d-40c4c3871a56 service nova] Acquired lock "refresh_cache-83ea4f5e-3381-4561-8bdb-868466b4d49d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG nova.network.neutron [req-a3fe0353-8f19-4173-b259-f03572338059 req-1f7451a3-19db-4404-835d-40c4c3871a56 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Refreshing network info cache for port 3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:52 user nova-compute[72990]: INFO nova.compute.manager [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Terminating instance
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:09:53 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:09:53 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=7775MB free_disk=24.938602447509766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance da3f86d1-09e4-4c85-b275-145c86f1aa15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 0206498e-6ec9-4af7-a4bb-ea512b71e4be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 83ea4f5e-3381-4561-8bdb-868466b4d49d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance b0392f8e-364d-450b-84c7-7b3f631a3a58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance fbba3f29-4b57-43c8-aecd-27e8d3d85c44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 213d93d2-14b9-47fc-afb2-568545c6214c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-dca1546f-623d-43e8-942a-80c133a8885f req-3a822c7f-d8f0-4f78-8a6c-01b876da149b service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Received event network-vif-unplugged-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dca1546f-623d-43e8-942a-80c133a8885f req-3a822c7f-d8f0-4f78-8a6c-01b876da149b service nova] Acquiring lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dca1546f-623d-43e8-942a-80c133a8885f req-3a822c7f-d8f0-4f78-8a6c-01b876da149b service nova] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-dca1546f-623d-43e8-942a-80c133a8885f req-3a822c7f-d8f0-4f78-8a6c-01b876da149b service nova] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-dca1546f-623d-43e8-942a-80c133a8885f req-3a822c7f-d8f0-4f78-8a6c-01b876da149b service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] No waiting events found dispatching network-vif-unplugged-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-dca1546f-623d-43e8-942a-80c133a8885f req-3a822c7f-d8f0-4f78-8a6c-01b876da149b service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Received event network-vif-unplugged-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:09:53 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Instance destroyed successfully.
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lazy-loading 'resources' on Instance uuid 83ea4f5e-3381-4561-8bdb-868466b4d49d {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:06:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1325838409',display_name='tempest-TestStampPattern-server-1325838409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1325838409',id=42,image_ref='5f4b77a3-44e2-478f-b34d-4e7f4bf80c40',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLnR311AGfUBQnoCXVcWBj+0ahQsHJMZMsICHM9pMdM0SqwxaZxX2k42Vtz1wur5D7C2c2Z+aWIY4GEPKcd/XyikzDfg8PQJ3qOnMiQdQiAFgolbW2xxY+fNS+9ERDXhw==',key_name='tempest-TestStampPattern-1905683854',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:06:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e34fab9761d749e09b47e567fa51a7fb',ramdisk_id='',reservation_id='r-0c99riq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='da3f86d1-09e4-4c85-b275-145c86f1aa15',image_min_disk='1',image_min_ram='0',image_owner_id='e34fab9761d749e09b47e567fa51a7fb',image_owner_project_name='tempest-TestStampPattern-1496658836',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1496658836-project-member',image_user_id='ed6cd92bb0204e2f9afb35f8d9d2243b',owner_project_name='tempest-TestStampPattern-1496658836',owner_user_name='tempest-TestStampPattern-1496658836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:06:47Z,user_data=None,user_id='ed6cd92bb0204e2f9afb35f8d9d2243b',uuid=83ea4f5e-3381-4561-8bdb-868466b4d49d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "address": "fa:16:3e:79:f3:1f", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3a4f8d-49", "ovs_interfaceid": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Converting VIF {"id": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "address": "fa:16:3e:79:f3:1f", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3a4f8d-49", "ovs_interfaceid": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3a4f8d-49') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG os_vif [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3a4f8d-49') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a3a4f8d-49, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:09:53 user nova-compute[72990]: INFO os_vif [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3a4f8d-49')
Aug 27 04:09:53 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Deleting instance files /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d_del
Aug 27 04:09:53 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Deletion of /opt/stack/data/nova/instances/83ea4f5e-3381-4561-8bdb-868466b4d49d_del complete
Aug 27 04:09:54 user nova-compute[72990]: INFO nova.compute.manager [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 27 04:09:54 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG nova.network.neutron [req-a3fe0353-8f19-4173-b259-f03572338059 req-1f7451a3-19db-4404-835d-40c4c3871a56 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Updated VIF entry in instance network info cache for port 3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG nova.network.neutron [req-a3fe0353-8f19-4173-b259-f03572338059 req-1f7451a3-19db-4404-835d-40c4c3871a56 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Updating instance_info_cache with network_info: [{"id": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "address": "fa:16:3e:79:f3:1f", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3a4f8d-49", "ovs_interfaceid": "3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-a3fe0353-8f19-4173-b259-f03572338059 req-1f7451a3-19db-4404-835d-40c4c3871a56 service nova] Releasing lock "refresh_cache-83ea4f5e-3381-4561-8bdb-868466b4d49d" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:09:54 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Took 0.63 seconds to deallocate network for instance.
Aug 27 04:09:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-0206498e-6ec9-4af7-a4bb-ea512b71e4be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-0206498e-6ec9-4af7-a4bb-ea512b71e4be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:54 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:55 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Deleted allocations for instance 83ea4f5e-3381-4561-8bdb-868466b4d49d
Aug 27 04:09:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f11325d7-2138-4dd1-8e01-f70501a26c6b tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.212s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Updating instance_info_cache with network_info: [{"id": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "address": "fa:16:3e:d1:9d:84", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1563d87c-b7", "ovs_interfaceid": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-0206498e-6ec9-4af7-a4bb-ea512b71e4be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109380.2709053, 418f0216-43b8-4437-b1ee-8cbff5830c4e => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:09:55 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] VM Stopped (Lifecycle Event)
Aug 27 04:09:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-10370fd0-5ee6-4faf-b31c-c405b51a072f None None] [instance: 418f0216-43b8-4437-b1ee-8cbff5830c4e] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-8b95a2be-cf5d-4435-acf4-13a13b56db09 req-ced745a2-2104-4a63-b482-7765120b78b7 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Received event network-vif-plugged-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8b95a2be-cf5d-4435-acf4-13a13b56db09 req-ced745a2-2104-4a63-b482-7765120b78b7 service nova] Acquiring lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8b95a2be-cf5d-4435-acf4-13a13b56db09 req-ced745a2-2104-4a63-b482-7765120b78b7 service nova] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8b95a2be-cf5d-4435-acf4-13a13b56db09 req-ced745a2-2104-4a63-b482-7765120b78b7 service nova] Lock "83ea4f5e-3381-4561-8bdb-868466b4d49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:09:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-8b95a2be-cf5d-4435-acf4-13a13b56db09 req-ced745a2-2104-4a63-b482-7765120b78b7 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] No waiting events found dispatching network-vif-plugged-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:09:55 user nova-compute[72990]: WARNING nova.compute.manager [req-8b95a2be-cf5d-4435-acf4-13a13b56db09 req-ced745a2-2104-4a63-b482-7765120b78b7 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Received unexpected event network-vif-plugged-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 for instance with vm_state deleted and task_state None.
Aug 27 04:09:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-8b95a2be-cf5d-4435-acf4-13a13b56db09 req-ced745a2-2104-4a63-b482-7765120b78b7 service nova] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Received event network-vif-deleted-3a3a4f8d-4927-45c8-8dcd-6927ffa7fe51 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:09:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:09:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:08 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109393.8788052, 83ea4f5e-3381-4561-8bdb-868466b4d49d => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:10:08 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] VM Stopped (Lifecycle Event)
Aug 27 04:10:08 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2912e1f9-b880-4ec5-9a13-46623ea5daab None None] [instance: 83ea4f5e-3381-4561-8bdb-868466b4d49d] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:10:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG nova.objects.instance [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lazy-loading 'flavor' on Instance uuid b0392f8e-364d-450b-84c7-7b3f631a3a58 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:14 user nova-compute[72990]: INFO nova.compute.manager [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Attaching volume 5d7ec106-48e7-483d-9504-4944bf99ba25 to /dev/vdb
Aug 27 04:10:14 user nova-compute[72990]: DEBUG os_brick.utils [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed96187-a39f-4636-9970-ef081e6302be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd0bfdf-0fd3-4bf8-9c59-6b8d1ab6378d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e441749-8c6d-4288-b120-30bbb185219a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb248fc-3a2e-4c37-b15f-dc5132eddd79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:10:15 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:10:15 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c472a56-7aad-4db8-9153-747546bc6ebd]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG os_brick.utils [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:10:15 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updating existing volume attachment record: 2919fda7-ec2b-4a5e-8e27-e32320b72868 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:10:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:10:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:10:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bZYKVlzo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:10:25 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:10:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:10:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:10:25 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:10:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:10:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:10:25 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:10:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d55855-9160-41b9-9d0d-54ca59b3a7e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:10:25 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:10:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[554938f3-7ab8-4eb0-b511-e7c91f1ccd9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25] added
Aug 27 04:10:25 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:10:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4f8980-eb46-46d3-8550-4ce061d88935]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0afefb-930e-411f-b3d6-e869317400f3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bZYKVlzo {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bZYKVlzo" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[96959087-7751-46e7-ae9f-fffdefc1bb00]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bZYKVlzo'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2829d32-9e9b-4963-bb6c-2cc71e3b451e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2c093a-46c0-4737-b54d-03cf975ca13e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:10:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:10:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88e4c8e-26fa-4976-975f-bf4c0b2b38bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25, portal: 172.16.0.220,3260]
Aug 27 04:10:26 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25, portal: 172.16.0.220,3260] successful.
Aug 27 04:10:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b616fb3-8bee-400c-b4b8-1b4f617fb04a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c544ebdf-999f-45f1-ac4b-20f663880216]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:10:26 user nova-compute[72990]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:10:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:10:26 user nova-compute[72990]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:10:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd80c99-ce8a-4e54-b600-264b456e0f9c]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:10:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bZYKVlzo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:10:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:10:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23535633438636237', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:10:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535633438636237', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:10:27 user nova-compute[72990]: DEBUG nova.objects.instance [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lazy-loading 'flavor' on Instance uuid b0392f8e-364d-450b-84c7-7b3f631a3a58 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:10:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:10:27 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:10:27 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 04:10:27 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:10:27 user nova-compute[72990]:   <serial>5d7ec106-48e7-483d-9504-4944bf99ba25</serial>
Aug 27 04:10:27 user nova-compute[72990]: </disk>
Aug 27 04:10:27 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:10:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:10:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:10:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] No VIF found with MAC fa:16:3e:f4:d3:f0, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:10:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-afebfd1a-b180-4ea4-b50a-29953a36a317 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.910s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-389a1c47-1f4f-46c1-bc1c-5d36aa0616ad req-faa2f2f9-0a20-48c1-934b-34d0758b440c service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-changed-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:10:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-389a1c47-1f4f-46c1-bc1c-5d36aa0616ad req-faa2f2f9-0a20-48c1-934b-34d0758b440c service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Refreshing instance network info cache due to event network-changed-04dc6ccc-6386-4870-86a2-2cfd0973ec3a. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:10:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-389a1c47-1f4f-46c1-bc1c-5d36aa0616ad req-faa2f2f9-0a20-48c1-934b-34d0758b440c service nova] Acquiring lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:10:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-389a1c47-1f4f-46c1-bc1c-5d36aa0616ad req-faa2f2f9-0a20-48c1-934b-34d0758b440c service nova] Acquired lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:10:30 user nova-compute[72990]: DEBUG nova.network.neutron [req-389a1c47-1f4f-46c1-bc1c-5d36aa0616ad req-faa2f2f9-0a20-48c1-934b-34d0758b440c service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Refreshing network info cache for port 04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:10:31 user nova-compute[72990]: DEBUG nova.network.neutron [req-389a1c47-1f4f-46c1-bc1c-5d36aa0616ad req-faa2f2f9-0a20-48c1-934b-34d0758b440c service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updated VIF entry in instance network info cache for port 04dc6ccc-6386-4870-86a2-2cfd0973ec3a. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:10:31 user nova-compute[72990]: DEBUG nova.network.neutron [req-389a1c47-1f4f-46c1-bc1c-5d36aa0616ad req-faa2f2f9-0a20-48c1-934b-34d0758b440c service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updating instance_info_cache with network_info: [{"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:10:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-389a1c47-1f4f-46c1-bc1c-5d36aa0616ad req-faa2f2f9-0a20-48c1-934b-34d0758b440c service nova] Releasing lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-7ba8a050-a1e8-45ef-ab2c-e32758eb04f1 req-858ef6b4-226d-4773-a270-54be1dd543c0 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-changed-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG nova.compute.manager [req-7ba8a050-a1e8-45ef-ab2c-e32758eb04f1 req-858ef6b4-226d-4773-a270-54be1dd543c0 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Refreshing instance network info cache due to event network-changed-04dc6ccc-6386-4870-86a2-2cfd0973ec3a. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7ba8a050-a1e8-45ef-ab2c-e32758eb04f1 req-858ef6b4-226d-4773-a270-54be1dd543c0 service nova] Acquiring lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7ba8a050-a1e8-45ef-ab2c-e32758eb04f1 req-858ef6b4-226d-4773-a270-54be1dd543c0 service nova] Acquired lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-7ba8a050-a1e8-45ef-ab2c-e32758eb04f1 req-858ef6b4-226d-4773-a270-54be1dd543c0 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Refreshing network info cache for port 04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-7ba8a050-a1e8-45ef-ab2c-e32758eb04f1 req-858ef6b4-226d-4773-a270-54be1dd543c0 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updated VIF entry in instance network info cache for port 04dc6ccc-6386-4870-86a2-2cfd0973ec3a. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-7ba8a050-a1e8-45ef-ab2c-e32758eb04f1 req-858ef6b4-226d-4773-a270-54be1dd543c0 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updating instance_info_cache with network_info: [{"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7ba8a050-a1e8-45ef-ab2c-e32758eb04f1 req-858ef6b4-226d-4773-a270-54be1dd543c0 service nova] Releasing lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:33 user nova-compute[72990]: INFO nova.compute.manager [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Rebooting instance
Aug 27 04:10:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquired lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:10:33 user nova-compute[72990]: DEBUG nova.network.neutron [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:10:34 user nova-compute[72990]: DEBUG nova.network.neutron [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updating instance_info_cache with network_info: [{"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:10:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Releasing lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:10:34 user nova-compute[72990]: DEBUG nova.compute.manager [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:10:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-c62f7762-db0c-48d1-9b0f-f2908c9ff260 req-e4ddbb5e-b953-4a3b-a810-254e2561fd0e service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-vif-unplugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:10:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c62f7762-db0c-48d1-9b0f-f2908c9ff260 req-e4ddbb5e-b953-4a3b-a810-254e2561fd0e service nova] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c62f7762-db0c-48d1-9b0f-f2908c9ff260 req-e4ddbb5e-b953-4a3b-a810-254e2561fd0e service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c62f7762-db0c-48d1-9b0f-f2908c9ff260 req-e4ddbb5e-b953-4a3b-a810-254e2561fd0e service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-c62f7762-db0c-48d1-9b0f-f2908c9ff260 req-e4ddbb5e-b953-4a3b-a810-254e2561fd0e service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] No waiting events found dispatching network-vif-unplugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:10:36 user nova-compute[72990]: WARNING nova.compute.manager [req-c62f7762-db0c-48d1-9b0f-f2908c9ff260 req-e4ddbb5e-b953-4a3b-a810-254e2561fd0e service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received unexpected event network-vif-unplugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a for instance with vm_state active and task_state reboot_started.
Aug 27 04:10:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:37 user nova-compute[72990]: INFO nova.compute.manager [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Terminating instance
Aug 27 04:10:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:37 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Instance shutdown successfully.
Aug 27 04:10:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-bfe3ca01-56a2-443e-b3a1-94f434c4bf81 req-9b704a5e-d1c9-4dfc-aaae-6a953c3a8dab service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Received event network-vif-unplugged-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bfe3ca01-56a2-443e-b3a1-94f434c4bf81 req-9b704a5e-d1c9-4dfc-aaae-6a953c3a8dab service nova] Acquiring lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bfe3ca01-56a2-443e-b3a1-94f434c4bf81 req-9b704a5e-d1c9-4dfc-aaae-6a953c3a8dab service nova] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bfe3ca01-56a2-443e-b3a1-94f434c4bf81 req-9b704a5e-d1c9-4dfc-aaae-6a953c3a8dab service nova] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-bfe3ca01-56a2-443e-b3a1-94f434c4bf81 req-9b704a5e-d1c9-4dfc-aaae-6a953c3a8dab service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] No waiting events found dispatching network-vif-unplugged-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:10:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-bfe3ca01-56a2-443e-b3a1-94f434c4bf81 req-9b704a5e-d1c9-4dfc-aaae-6a953c3a8dab service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Received event network-vif-unplugged-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Instance destroyed successfully.
Aug 27 04:10:38 user nova-compute[72990]: DEBUG nova.objects.instance [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lazy-loading 'resources' on Instance uuid 0206498e-6ec9-4af7-a4bb-ea512b71e4be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-359727757',display_name='tempest-TestVolumeBootPattern-volume-backed-server-359727757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-359727757',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALjER765KgqLrzDxo8VaGe/D8luY+wrGAccnvTzMRQQKIX5gFAK28LkVvUTbh8GucXsSYgkXpFWvOJy+1D6MbyZm0WMYDAAQh744EP6FKvyxjnKejNZqtxmW9yCoO9bMQ==',key_name='tempest-keypair-1971179342',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:05:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-z7nmp7ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf3112e616344af7873a50d134260637',uuid=0206498e-6ec9-4af7-a4bb-ea512b71e4be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "address": "fa:16:3e:d1:9d:84", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1563d87c-b7", "ovs_interfaceid": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "address": "fa:16:3e:d1:9d:84", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1563d87c-b7", "ovs_interfaceid": "1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1563d87c-b7') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_vif [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1563d87c-b7') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1563d87c-b7, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:38 user nova-compute[72990]: INFO os_vif [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1563d87c-b7')
Aug 27 04:10:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqQBUKmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:10:38 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[40408a29-3b11-4698-8094-4fe8a93e1376]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[561182ea-8ed4-4a44-ad80-9c88b917e583]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:10:38 user nova-compute[72990]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:10:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c (non-flash)
Aug 27 04:10:38 user nova-compute[72990]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:10:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7143c9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f358bc-b607-453f-b565-edcce04c00df]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7505029c-07e1-49dc-9e5d-ae1df288ab10]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a4c9b6-299a-43c1-8d50-00de4b31ec17]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfd591c-2975-4fba-a115-45ce409f43cf]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6d0a68-caf7-4f5e-aba1-df6034a355cc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c10ce1-f5a0-4fbe-a450-ebbeac729223]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c, portal: 172.16.0.220,3260]
Aug 27 04:10:38 user nova-compute[72990]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c, portal: 172.16.0.220,3260] successful.
Aug 27 04:10:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc13f7b0-0c8a-4393-992a-7bfb661ddf3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2335b5f6-83ef-4476-967d-014f59f9b17b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== disconnect_volume: return (280ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:10:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Deleting instance files /opt/stack/data/nova/instances/0206498e-6ec9-4af7-a4bb-ea512b71e4be_del
Aug 27 04:10:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Deletion of /opt/stack/data/nova/instances/0206498e-6ec9-4af7-a4bb-ea512b71e4be_del complete
Aug 27 04:10:38 user nova-compute[72990]: INFO nova.compute.manager [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Took 1.59 seconds to destroy the instance on the hypervisor.
Aug 27 04:10:38 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:10:38 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-eb3038b9-00ee-4590-be53-71c7f0d5cf93 req-23ff0198-348e-4d56-a8f5-fea487fdea06 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-eb3038b9-00ee-4590-be53-71c7f0d5cf93 req-23ff0198-348e-4d56-a8f5-fea487fdea06 service nova] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-eb3038b9-00ee-4590-be53-71c7f0d5cf93 req-23ff0198-348e-4d56-a8f5-fea487fdea06 service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-eb3038b9-00ee-4590-be53-71c7f0d5cf93 req-23ff0198-348e-4d56-a8f5-fea487fdea06 service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-eb3038b9-00ee-4590-be53-71c7f0d5cf93 req-23ff0198-348e-4d56-a8f5-fea487fdea06 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] No waiting events found dispatching network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:10:39 user nova-compute[72990]: WARNING nova.compute.manager [req-eb3038b9-00ee-4590-be53-71c7f0d5cf93 req-23ff0198-348e-4d56-a8f5-fea487fdea06 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received unexpected event network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a for instance with vm_state active and task_state reboot_started.
Aug 27 04:10:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-4e3eb489-dd10-4f55-bdf2-371ea5da9985 req-21aedd12-9694-4320-9404-bd8670ea4ed6 service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Received event network-vif-plugged-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4e3eb489-dd10-4f55-bdf2-371ea5da9985 req-21aedd12-9694-4320-9404-bd8670ea4ed6 service nova] Acquiring lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4e3eb489-dd10-4f55-bdf2-371ea5da9985 req-21aedd12-9694-4320-9404-bd8670ea4ed6 service nova] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4e3eb489-dd10-4f55-bdf2-371ea5da9985 req-21aedd12-9694-4320-9404-bd8670ea4ed6 service nova] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-4e3eb489-dd10-4f55-bdf2-371ea5da9985 req-21aedd12-9694-4320-9404-bd8670ea4ed6 service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] No waiting events found dispatching network-vif-plugged-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:10:39 user nova-compute[72990]: WARNING nova.compute.manager [req-4e3eb489-dd10-4f55-bdf2-371ea5da9985 req-21aedd12-9694-4320-9404-bd8670ea4ed6 service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Received unexpected event network-vif-plugged-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb for instance with vm_state active and task_state deleting.
Aug 27 04:10:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:40 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:10:40 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Took 1.54 seconds to deallocate network for instance.
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] No waiting events found dispatching network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:10:41 user nova-compute[72990]: WARNING nova.compute.manager [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received unexpected event network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a for instance with vm_state active and task_state reboot_started.
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] No waiting events found dispatching network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:10:41 user nova-compute[72990]: WARNING nova.compute.manager [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received unexpected event network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a for instance with vm_state active and task_state reboot_started.
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-f86deea4-59f1-478b-a5cf-0527db6d9d8b req-81fd5ab4-aefa-4feb-8687-a35b8b666385 service nova] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Received event network-vif-deleted-1563d87c-b7d3-4e8a-bb25-ff8b505f4ccb {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Removed pending event for b0392f8e-364d-450b-84c7-7b3f631a3a58 due to event {{(pid=72990) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109441.3226304, b0392f8e-364d-450b-84c7-7b3f631a3a58 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:10:41 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] VM Resumed (Lifecycle Event)
Aug 27 04:10:41 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Instance running successfully.
Aug 27 04:10:41 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Instance soft rebooted successfully.
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:10:41 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109441.3244586, b0392f8e-364d-450b-84c7-7b3f631a3a58 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:10:41 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] VM Started (Lifecycle Event)
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-0892bd09-f146-43b2-9c21-f48f118e06bc tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.474s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:41 user nova-compute[72990]: INFO nova.compute.manager [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Took 0.99 seconds to detach 1 volumes for instance.
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Deleting volume: dc13f7b0-0c8a-4393-992a-7bfb661ddf3c {{(pid=72990) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:10:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:41 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Deleted allocations for instance 0206498e-6ec9-4af7-a4bb-ea512b71e4be
Aug 27 04:10:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-79767509-9f73-4a90-8c34-2a2aac7d4f7c tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "0206498e-6ec9-4af7-a4bb-ea512b71e4be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.672s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:43 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:10:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-b9fa16b3-a43e-458b-8ebb-90a46045b6b9 req-1b3a8069-c977-44a7-9a27-9c3173ee3ed6 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Received event network-changed-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:10:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-b9fa16b3-a43e-458b-8ebb-90a46045b6b9 req-1b3a8069-c977-44a7-9a27-9c3173ee3ed6 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Refreshing instance network info cache due to event network-changed-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:10:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b9fa16b3-a43e-458b-8ebb-90a46045b6b9 req-1b3a8069-c977-44a7-9a27-9c3173ee3ed6 service nova] Acquiring lock "refresh_cache-8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:10:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b9fa16b3-a43e-458b-8ebb-90a46045b6b9 req-1b3a8069-c977-44a7-9a27-9c3173ee3ed6 service nova] Acquired lock "refresh_cache-8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:10:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-b9fa16b3-a43e-458b-8ebb-90a46045b6b9 req-1b3a8069-c977-44a7-9a27-9c3173ee3ed6 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Refreshing network info cache for port 6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:10:45 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:10:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:10:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-b9fa16b3-a43e-458b-8ebb-90a46045b6b9 req-1b3a8069-c977-44a7-9a27-9c3173ee3ed6 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Updated VIF entry in instance network info cache for port 6f766b68-0ddc-407e-974f-ef2ef3c8d1ca. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:10:45 user nova-compute[72990]: DEBUG nova.network.neutron [req-b9fa16b3-a43e-458b-8ebb-90a46045b6b9 req-1b3a8069-c977-44a7-9a27-9c3173ee3ed6 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Updating instance_info_cache with network_info: [{"id": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "address": "fa:16:3e:e9:51:05", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f766b68-0d", "ovs_interfaceid": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:10:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b9fa16b3-a43e-458b-8ebb-90a46045b6b9 req-1b3a8069-c977-44a7-9a27-9c3173ee3ed6 service nova] Releasing lock "refresh_cache-8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:10:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:48 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:10:50 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:10:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:50 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:10:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:10:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:10:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:10:53 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:10:53 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8007MB free_disk=24.907978057861328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance da3f86d1-09e4-4c85-b275-145c86f1aa15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance b0392f8e-364d-450b-84c7-7b3f631a3a58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance fbba3f29-4b57-43c8-aecd-27e8d3d85c44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 213d93d2-14b9-47fc-afb2-568545c6214c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109438.4907498, 0206498e-6ec9-4af7-a4bb-ea512b71e4be => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:10:53 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] VM Stopped (Lifecycle Event)
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2c5a3ca0-1328-4bca-86cd-2e14bc844bd8 None None] [instance: 0206498e-6ec9-4af7-a4bb-ea512b71e4be] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:10:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:10:54 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:10:54 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:10:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:10:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Didn't find any instances for network info cache update. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 04:10:54 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:10:54 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:10:54 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:10:56 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:10:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:10:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:01 user nova-compute[72990]: INFO nova.compute.manager [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Attaching volume ff91fcd6-a120-4c08-af38-08f6440660fb to /dev/vdb
Aug 27 04:11:01 user nova-compute[72990]: DEBUG os_brick.utils [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ff89bc-4d17-417a-8ec7-f2be02c24cf5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6a26b6-ea24-4f4b-816d-c1b87b242cd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf953d9-3e4f-47b0-8d6a-7cd27ff283b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb74c6f-3746-4ab8-89de-fbeae59f2de6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:11:01 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:11:01 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d5dc2d-2a98-4b05-8bf5-b2a5b7ba898e]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG os_brick.utils [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:11:01 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Updating existing volume attachment record: 335cc88e-9595-494c-a9f6-b17874443e27 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:11:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:08 user nova-compute[72990]: INFO nova.compute.manager [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Terminating instance
Aug 27 04:11:08 user nova-compute[72990]: DEBUG nova.compute.manager [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-457f8486-db73-4874-90b8-c97a6a8effea req-a19e95a6-1da9-4f18-a2ef-7ea3482f240f service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Received event network-changed-449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-457f8486-db73-4874-90b8-c97a6a8effea req-a19e95a6-1da9-4f18-a2ef-7ea3482f240f service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Refreshing instance network info cache due to event network-changed-449158a8-0249-4545-98c9-ecfccbcc1148. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-457f8486-db73-4874-90b8-c97a6a8effea req-a19e95a6-1da9-4f18-a2ef-7ea3482f240f service nova] Acquiring lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-457f8486-db73-4874-90b8-c97a6a8effea req-a19e95a6-1da9-4f18-a2ef-7ea3482f240f service nova] Acquired lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG nova.network.neutron [req-457f8486-db73-4874-90b8-c97a6a8effea req-a19e95a6-1da9-4f18-a2ef-7ea3482f240f service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Refreshing network info cache for port 449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-8e49fd4a-2ed8-4191-95d2-04111a0ca311 req-8182b671-3e2f-4ca1-bc82-8202439edda7 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Received event network-vif-unplugged-449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8e49fd4a-2ed8-4191-95d2-04111a0ca311 req-8182b671-3e2f-4ca1-bc82-8202439edda7 service nova] Acquiring lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8e49fd4a-2ed8-4191-95d2-04111a0ca311 req-8182b671-3e2f-4ca1-bc82-8202439edda7 service nova] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8e49fd4a-2ed8-4191-95d2-04111a0ca311 req-8182b671-3e2f-4ca1-bc82-8202439edda7 service nova] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-8e49fd4a-2ed8-4191-95d2-04111a0ca311 req-8182b671-3e2f-4ca1-bc82-8202439edda7 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] No waiting events found dispatching network-vif-unplugged-449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:11:08 user nova-compute[72990]: DEBUG nova.compute.manager [req-8e49fd4a-2ed8-4191-95d2-04111a0ca311 req-8182b671-3e2f-4ca1-bc82-8202439edda7 service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Received event network-vif-unplugged-449158a8-0249-4545-98c9-ecfccbcc1148 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:11:09 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Instance destroyed successfully.
Aug 27 04:11:09 user nova-compute[72990]: DEBUG nova.objects.instance [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lazy-loading 'resources' on Instance uuid da3f86d1-09e4-4c85-b275-145c86f1aa15 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:03:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2126323888',display_name='tempest-TestStampPattern-server-2126323888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2126323888',id=39,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLnR311AGfUBQnoCXVcWBj+0ahQsHJMZMsICHM9pMdM0SqwxaZxX2k42Vtz1wur5D7C2c2Z+aWIY4GEPKcd/XyikzDfg8PQJ3qOnMiQdQiAFgolbW2xxY+fNS+9ERDXhw==',key_name='tempest-TestStampPattern-1905683854',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:03:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e34fab9761d749e09b47e567fa51a7fb',ramdisk_id='',reservation_id='r-lz0wn5m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1496658836',owner_user_name='tempest-TestStampPattern-1496658836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:06:37Z,user_data=None,user_id='ed6cd92bb0204e2f9afb35f8d9d2243b',uuid=da3f86d1-09e4-4c85-b275-145c86f1aa15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Converting VIF {"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:c0:a1,bridge_name='br-int',has_traffic_filtering=True,id=449158a8-0249-4545-98c9-ecfccbcc1148,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449158a8-02') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG os_vif [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:c0:a1,bridge_name='br-int',has_traffic_filtering=True,id=449158a8-0249-4545-98c9-ecfccbcc1148,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449158a8-02') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap449158a8-02, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:11:09 user nova-compute[72990]: INFO os_vif [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:c0:a1,bridge_name='br-int',has_traffic_filtering=True,id=449158a8-0249-4545-98c9-ecfccbcc1148,network=Network(2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449158a8-02')
Aug 27 04:11:09 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Deleting instance files /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15_del
Aug 27 04:11:09 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Deletion of /opt/stack/data/nova/instances/da3f86d1-09e4-4c85-b275-145c86f1aa15_del complete
Aug 27 04:11:09 user nova-compute[72990]: INFO nova.compute.manager [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 27 04:11:09 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG nova.network.neutron [req-457f8486-db73-4874-90b8-c97a6a8effea req-a19e95a6-1da9-4f18-a2ef-7ea3482f240f service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updated VIF entry in instance network info cache for port 449158a8-0249-4545-98c9-ecfccbcc1148. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG nova.network.neutron [req-457f8486-db73-4874-90b8-c97a6a8effea req-a19e95a6-1da9-4f18-a2ef-7ea3482f240f service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updating instance_info_cache with network_info: [{"id": "449158a8-0249-4545-98c9-ecfccbcc1148", "address": "fa:16:3e:6d:c0:a1", "network": {"id": "2b08a48b-793a-409c-a7ed-7d7c1d9b2a8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1786456139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34fab9761d749e09b47e567fa51a7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449158a8-02", "ovs_interfaceid": "449158a8-0249-4545-98c9-ecfccbcc1148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:11:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-457f8486-db73-4874-90b8-c97a6a8effea req-a19e95a6-1da9-4f18-a2ef-7ea3482f240f service nova] Releasing lock "refresh_cache-da3f86d1-09e4-4c85-b275-145c86f1aa15" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:11:10 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:11:10 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Took 1.09 seconds to deallocate network for instance.
Aug 27 04:11:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:10 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:11:10 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:11:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:10 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Deleted allocations for instance da3f86d1-09e4-4c85-b275-145c86f1aa15
Aug 27 04:11:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-58c1d1f6-65da-43e1-99f5-9f54e1370e54 tempest-TestStampPattern-1496658836 tempest-TestStampPattern-1496658836-project-member] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.352s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-b3632c75-ee70-441f-8c89-d8afecf4273b req-f6c7ad76-098e-4391-ad84-d14d8473154d service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Received event network-vif-plugged-449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:11:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b3632c75-ee70-441f-8c89-d8afecf4273b req-f6c7ad76-098e-4391-ad84-d14d8473154d service nova] Acquiring lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b3632c75-ee70-441f-8c89-d8afecf4273b req-f6c7ad76-098e-4391-ad84-d14d8473154d service nova] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b3632c75-ee70-441f-8c89-d8afecf4273b req-f6c7ad76-098e-4391-ad84-d14d8473154d service nova] Lock "da3f86d1-09e4-4c85-b275-145c86f1aa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-b3632c75-ee70-441f-8c89-d8afecf4273b req-f6c7ad76-098e-4391-ad84-d14d8473154d service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] No waiting events found dispatching network-vif-plugged-449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:11:10 user nova-compute[72990]: WARNING nova.compute.manager [req-b3632c75-ee70-441f-8c89-d8afecf4273b req-f6c7ad76-098e-4391-ad84-d14d8473154d service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Received unexpected event network-vif-plugged-449158a8-0249-4545-98c9-ecfccbcc1148 for instance with vm_state deleted and task_state None.
Aug 27 04:11:10 user nova-compute[72990]: DEBUG nova.compute.manager [req-b3632c75-ee70-441f-8c89-d8afecf4273b req-f6c7ad76-098e-4391-ad84-d14d8473154d service nova] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Received event network-vif-deleted-449158a8-0249-4545-98c9-ecfccbcc1148 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNPUMbLB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:11:13 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:11:13 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:11:13 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c691a61-2700-49f6-a518-192453e643b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:11:13 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c258c9b0-e7b5-4670-860b-aa77a6be16b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb] added
Aug 27 04:11:13 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[46286fc8-6dcc-48d0-92a9-9eb8b9d9fedc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31dc905-c68a-4755-ae42-15f2699aa982]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNPUMbLB {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNPUMbLB" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbe4f5f-892a-4097-98b6-cae7c73f62a5]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNPUMbLB'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da4b6de-f675-4b64-9c78-58a103326a47]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[758e1dd7-d188-4c4d-86e5-0ae8b94f319e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:13 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:13 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3214f8-c9cb-45cd-962c-f78ad408e7e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb, portal: 172.16.0.220,3260]
Aug 27 04:11:13 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb, portal: 172.16.0.220,3260] successful.
Aug 27 04:11:13 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[97350fc4-4890-4365-8cf1-b0681af120c1]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5c9755-7d0c-4275-82df-fd806aaa656e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:13 user nova-compute[72990]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)
Aug 27 04:11:13 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:13 user nova-compute[72990]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)
Aug 27 04:11:13 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-283bfada-eb9d-4807-ae22-b93dfe1e4428 req-a22f447b-d4f9-4510-8e9b-98f4b88505e4 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Received event network-changed-0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-283bfada-eb9d-4807-ae22-b93dfe1e4428 req-a22f447b-d4f9-4510-8e9b-98f4b88505e4 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Refreshing instance network info cache due to event network-changed-0498f2e1-b488-4c8b-90f6-51343e41b0df. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-283bfada-eb9d-4807-ae22-b93dfe1e4428 req-a22f447b-d4f9-4510-8e9b-98f4b88505e4 service nova] Acquiring lock "refresh_cache-fbba3f29-4b57-43c8-aecd-27e8d3d85c44" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-283bfada-eb9d-4807-ae22-b93dfe1e4428 req-a22f447b-d4f9-4510-8e9b-98f4b88505e4 service nova] Acquired lock "refresh_cache-fbba3f29-4b57-43c8-aecd-27e8d3d85c44" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG nova.network.neutron [req-283bfada-eb9d-4807-ae22-b93dfe1e4428 req-a22f447b-d4f9-4510-8e9b-98f4b88505e4 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Refreshing network info cache for port 0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3a97c0-f558-4976-b01d-9a7316958a33]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:13 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG nova.objects.instance [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lazy-loading 'flavor' on Instance uuid fbba3f29-4b57-43c8-aecd-27e8d3d85c44 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:11:14 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Ignoring supplied device name: /dev/vdb
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:14 user nova-compute[72990]: INFO nova.compute.manager [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Attaching volume 1d4473e7-4ada-4c14-9f06-7be6222c1006 to /dev/vdb
Aug 27 04:11:14 user nova-compute[72990]: DEBUG nova.network.neutron [req-283bfada-eb9d-4807-ae22-b93dfe1e4428 req-a22f447b-d4f9-4510-8e9b-98f4b88505e4 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Updated VIF entry in instance network info cache for port 0498f2e1-b488-4c8b-90f6-51343e41b0df. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG nova.network.neutron [req-283bfada-eb9d-4807-ae22-b93dfe1e4428 req-a22f447b-d4f9-4510-8e9b-98f4b88505e4 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Updating instance_info_cache with network_info: [{"id": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "address": "fa:16:3e:05:61:fa", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0498f2e1-b4", "ovs_interfaceid": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG os_brick.utils [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-283bfada-eb9d-4807-ae22-b93dfe1e4428 req-a22f447b-d4f9-4510-8e9b-98f4b88505e4 service nova] Releasing lock "refresh_cache-fbba3f29-4b57-43c8-aecd-27e8d3d85c44" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[861436c4-1b82-4868-8f70-d470b0fe9054]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b53cddb-423c-4f04-809e-c542e9967dd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[264d95bc-5176-4323-b9f4-32849568012d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfd1fba-1227-4c7e-887e-ca8ba4575c0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:11:14 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:11:14 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7b4870-429f-4761-80e3-6b0a184561df]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG os_brick.utils [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Updating existing volume attachment record: 44092884-37a5-44fc-a763-f01f34b50903 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNPUMbLB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23462383038363636', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462383038363636', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:11:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:11:14 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:11:14 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:11:14 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:11:14 user nova-compute[72990]:   <serial>ff91fcd6-a120-4c08-af38-08f6440660fb</serial>
Aug 27 04:11:14 user nova-compute[72990]: </disk>
Aug 27 04:11:14 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:11:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:11:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:11:15 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No VIF found with MAC fa:16:3e:e9:51:05, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:11:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f0f9da54-2295-4637-946e-7fca243917ea tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.705s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:20 user nova-compute[72990]: INFO nova.compute.manager [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Attaching volume 5d7acaf3-e00d-4f06-b542-9907c641016a to /dev/vdc
Aug 27 04:11:20 user nova-compute[72990]: DEBUG os_brick.utils [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[976bab1a-135c-433f-a1e3-f25b2ef9709f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f6b5c6-fa8c-43d9-87b3-80cc4d643674]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[64302d82-7ab1-4f9f-acb4-d5d8700b12d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee96a3c6-eeb4-4a21-8979-fe8869ea369b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:11:20 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:11:20 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cae473-b24c-4d8d-b7de-8e5aa70ad0f0]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG os_brick.utils [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:11:20 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Updating existing volume attachment record: d401069c-c705-4e96-84d5-f95f9049a46c {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:11:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:24 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109469.16245, da3f86d1-09e4-4c85-b275-145c86f1aa15 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:11:24 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] VM Stopped (Lifecycle Event)
Aug 27 04:11:24 user nova-compute[72990]: DEBUG nova.compute.manager [None req-240c4687-0662-4707-9e6e-2a0881aaf138 None None] [instance: da3f86d1-09e4-4c85-b275-145c86f1aa15] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:11:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UciOSWQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:11:26 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:11:26 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:11:26 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d98fa8-7c30-4372-bbf5-51b7c106791c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:11:26 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[125bd269-5015-44a6-a58a-aff3c822bf3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006] added
Aug 27 04:11:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb71442-1d03-46ac-960d-fc297541b713]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a540d86-5b38-4edf-8f86-d4f63dc13b49]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UciOSWQz {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UciOSWQz" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d7c89b-dca3-4923-b951-828ee172d9f2]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UciOSWQz'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[437db7fe-7b1c-4252-95b1-8a5554e2384e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afe2881-80d3-46c7-8655-658a29b57940]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:26 user nova-compute[72990]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)
Aug 27 04:11:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:26 user nova-compute[72990]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)
Aug 27 04:11:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8012bbed-0aa7-48d0-b791-2fd5949fa34e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006, portal: 172.16.0.220,3260]
Aug 27 04:11:26 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006, portal: 172.16.0.220,3260] successful.
Aug 27 04:11:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e85d6b-a276-46e7-bfb5-f2bd89b5d9ea]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b5ab20-5dc3-49af-9aa0-cfe8c7a8812e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:26 user nova-compute[72990]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)
Aug 27 04:11:26 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:11:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:26 user nova-compute[72990]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)
Aug 27 04:11:26 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:11:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d84eec3-22f1-461a-8bb7-d53ecf99978f]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:26 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:11:27 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:11:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UciOSWQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:11:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:11:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26662643136396664', 'path': '/dev/sdd'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:11:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662643136396664', 'path': '/dev/sdd'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:11:27 user nova-compute[72990]: DEBUG nova.objects.instance [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lazy-loading 'flavor' on Instance uuid fbba3f29-4b57-43c8-aecd-27e8d3d85c44 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:11:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:11:27 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:11:27 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 04:11:27 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:11:27 user nova-compute[72990]:   <serial>1d4473e7-4ada-4c14-9f06-7be6222c1006</serial>
Aug 27 04:11:27 user nova-compute[72990]: </disk>
Aug 27 04:11:27 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:11:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:11:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:11:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] No VIF found with MAC fa:16:3e:05:61:fa, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:11:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a1ddf241-433e-4884-b8ea-4e00cf2cc1d0 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.827s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "213d93d2-14b9-47fc-afb2-568545c6214c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "213d93d2-14b9-47fc-afb2-568545c6214c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:28 user nova-compute[72990]: INFO nova.compute.manager [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Terminating instance
Aug 27 04:11:28 user nova-compute[72990]: DEBUG nova.compute.manager [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:11:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-bf7328f4-659f-42dc-b017-0bead5ecfe73 req-8e537531-bcb9-480a-987f-f6f1f82d73be service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Received event network-vif-unplugged-140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bf7328f4-659f-42dc-b017-0bead5ecfe73 req-8e537531-bcb9-480a-987f-f6f1f82d73be service nova] Acquiring lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bf7328f4-659f-42dc-b017-0bead5ecfe73 req-8e537531-bcb9-480a-987f-f6f1f82d73be service nova] Lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bf7328f4-659f-42dc-b017-0bead5ecfe73 req-8e537531-bcb9-480a-987f-f6f1f82d73be service nova] Lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-bf7328f4-659f-42dc-b017-0bead5ecfe73 req-8e537531-bcb9-480a-987f-f6f1f82d73be service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] No waiting events found dispatching network-vif-unplugged-140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG nova.compute.manager [req-bf7328f4-659f-42dc-b017-0bead5ecfe73 req-8e537531-bcb9-480a-987f-f6f1f82d73be service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Received event network-vif-unplugged-140b5171-14a7-4b11-9b01-a9badaa4654b for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:29 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Instance destroyed successfully.
Aug 27 04:11:29 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lazy-loading 'resources' on Instance uuid 213d93d2-14b9-47fc-afb2-568545c6214c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:09:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-887340108',display_name='tempest-VolumesActionsTest-instance-887340108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-887340108',id=47,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='161e68b849ab44c1bd68f134d620add6',ramdisk_id='',reservation_id='r-tgk0gw5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1193624458',owner_user_name='tempest-VolumesActionsTest-1193624458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:09:46Z,user_data=None,user_id='12f4f79d69a147568e4e0a44ffbf6591',uuid=213d93d2-14b9-47fc-afb2-568545c6214c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "140b5171-14a7-4b11-9b01-a9badaa4654b", "address": "fa:16:3e:cd:2e:b9", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140b5171-14", "ovs_interfaceid": "140b5171-14a7-4b11-9b01-a9badaa4654b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Converting VIF {"id": "140b5171-14a7-4b11-9b01-a9badaa4654b", "address": "fa:16:3e:cd:2e:b9", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140b5171-14", "ovs_interfaceid": "140b5171-14a7-4b11-9b01-a9badaa4654b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=140b5171-14a7-4b11-9b01-a9badaa4654b,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140b5171-14') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG os_vif [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=140b5171-14a7-4b11-9b01-a9badaa4654b,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140b5171-14') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap140b5171-14, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:11:29 user nova-compute[72990]: INFO os_vif [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:2e:b9,bridge_name='br-int',has_traffic_filtering=True,id=140b5171-14a7-4b11-9b01-a9badaa4654b,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140b5171-14')
Aug 27 04:11:29 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Deleting instance files /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c_del
Aug 27 04:11:29 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Deletion of /opt/stack/data/nova/instances/213d93d2-14b9-47fc-afb2-568545c6214c_del complete
Aug 27 04:11:29 user nova-compute[72990]: INFO nova.compute.manager [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 27 04:11:29 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:11:29 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:11:30 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:11:30 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Took 0.76 seconds to deallocate network for instance.
Aug 27 04:11:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-ad6840c5-248c-4dde-96f8-eba51dab0f70 req-0b9ac4ff-f7b2-461f-b2c6-696e327ba185 service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Received event network-vif-deleted-140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:11:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:30 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:11:30 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:11:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:30 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Deleted allocations for instance 213d93d2-14b9-47fc-afb2-568545c6214c
Aug 27 04:11:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c72ba7fb-d797-4d44-975a-006d44c3d206 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "213d93d2-14b9-47fc-afb2-568545c6214c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.011s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-69f829c8-322b-4ac2-8fb3-8e68c49b0e5c req-7b2810dc-4a3e-480f-8606-50e5e31a0efe service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Received event network-vif-plugged-140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:11:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-69f829c8-322b-4ac2-8fb3-8e68c49b0e5c req-7b2810dc-4a3e-480f-8606-50e5e31a0efe service nova] Acquiring lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-69f829c8-322b-4ac2-8fb3-8e68c49b0e5c req-7b2810dc-4a3e-480f-8606-50e5e31a0efe service nova] Lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-69f829c8-322b-4ac2-8fb3-8e68c49b0e5c req-7b2810dc-4a3e-480f-8606-50e5e31a0efe service nova] Lock "213d93d2-14b9-47fc-afb2-568545c6214c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:31 user nova-compute[72990]: DEBUG nova.compute.manager [req-69f829c8-322b-4ac2-8fb3-8e68c49b0e5c req-7b2810dc-4a3e-480f-8606-50e5e31a0efe service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] No waiting events found dispatching network-vif-plugged-140b5171-14a7-4b11-9b01-a9badaa4654b {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:11:31 user nova-compute[72990]: WARNING nova.compute.manager [req-69f829c8-322b-4ac2-8fb3-8e68c49b0e5c req-7b2810dc-4a3e-480f-8606-50e5e31a0efe service nova] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Received unexpected event network-vif-plugged-140b5171-14a7-4b11-9b01-a9badaa4654b for instance with vm_state deleted and task_state None.
Aug 27 04:11:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNembpIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:11:39 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:11:39 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:11:39 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37a51a8-b28a-42f9-98e1-c547e975ece3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:11:39 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[20589e03-d890-4386-9580-7d39fdae9782]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a] added
Aug 27 04:11:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0beb2030-e725-405c-b23c-06c27aa95220]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beef344-4770-482b-8058-35da754f64a8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNembpIH {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNembpIH" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb04f62-0b1c-47ff-9ba4-0cdf8b3fcd93]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WNembpIH'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea8dc50-31b6-45e8-818a-0e392490ec29]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c953a0e-6f5b-4c01-946e-e0f5961d8e08]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:39 user nova-compute[72990]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)
Aug 27 04:11:39 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:11:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:39 user nova-compute[72990]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)
Aug 27 04:11:39 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:11:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d091c2-f4cf-4524-bbd5-12f4a901a288]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a, portal: 172.16.0.220,3260]
Aug 27 04:11:39 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a, portal: 172.16.0.220,3260] successful.
Aug 27 04:11:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[39779340-a9f5-4b53-9a27-9e8a0907b7e2]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c2ddf0-1f71-4fba-bae8-cfa392625288]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:39 user nova-compute[72990]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)
Aug 27 04:11:39 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:11:39 user nova-compute[72990]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a (non-flash)
Aug 27 04:11:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:39 user nova-compute[72990]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)
Aug 27 04:11:39 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:11:39 user nova-compute[72990]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a (non-flash)
Aug 27 04:11:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] HCTL ('36', '-', '-', 0) found on session 52 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e105b06-03dd-429f-9699-e137f9190bc0]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNembpIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:11:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:11:40 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23863353761343233', 'path': '/dev/sde'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:11:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863353761343233', 'path': '/dev/sde'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:11:40 user nova-compute[72990]: DEBUG nova.objects.instance [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:11:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:11:40 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:11:40 user nova-compute[72990]:   <source dev="/dev/sde"/>
Aug 27 04:11:40 user nova-compute[72990]:   <target dev="vdc" bus="virtio"/>
Aug 27 04:11:40 user nova-compute[72990]:   <serial>5d7acaf3-e00d-4f06-b542-9907c641016a</serial>
Aug 27 04:11:40 user nova-compute[72990]: </disk>
Aug 27 04:11:40 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:11:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:11:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:11:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:11:40 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] No VIF found with MAC fa:16:3e:e9:51:05, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:11:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-f0df6b9d-3864-4c58-a763-63a2573b2908 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.241s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:41 user nova-compute[72990]: INFO nova.compute.manager [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Detaching volume ff91fcd6-a120-4c08-af38-08f6440660fb
Aug 27 04:11:41 user nova-compute[72990]: INFO nova.virt.block_device [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Attempting to driver detach volume ff91fcd6-a120-4c08-af38-08f6440660fb from mountpoint /dev/vdb
Aug 27 04:11:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Attempting to detach device vdb from instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:11:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:11:41 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:11:41 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:11:41 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:11:41 user nova-compute[72990]:   <serial>ff91fcd6-a120-4c08-af38-08f6440660fb</serial>
Aug 27 04:11:41 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:11:41 user nova-compute[72990]: </disk>
Aug 27 04:11:41 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:11:41 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully detached device vdb from instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 from the persistent domain config.
Aug 27 04:11:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:11:41 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:11:41 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:11:41 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:11:41 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:11:41 user nova-compute[72990]:   <serial>ff91fcd6-a120-4c08-af38-08f6440660fb</serial>
Aug 27 04:11:41 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:11:41 user nova-compute[72990]: </disk>
Aug 27 04:11:41 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693109502.0977025, 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:11:42 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully detached device vdb from instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 from the live domain config.
Aug 27 04:11:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNPUMbLB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:11:42 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[84968744-c17f-45fb-9d09-aac5fd48a057]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48c93c2-b92e-4e1f-8418-53e93540a028]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:42 user nova-compute[72990]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)
Aug 27 04:11:42 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:11:42 user nova-compute[72990]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a (non-flash)
Aug 27 04:11:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:42 user nova-compute[72990]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb (non-flash)
Aug 27 04:11:42 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:11:42 user nova-compute[72990]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a (non-flash)
Aug 27 04:11:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4161a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b6455-3f28-4811-ab05-c1fffab5cff7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[083c410a-d0b0-4d22-833e-4799ca5d0fc8]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb272c3f-b437-460f-ae97-92c598995327]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d007aeb-e800-4771-82b2-eb6c2e76aa87]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[625f4a0d-3fa7-4aca-a3dd-061d4c6fb15c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cd4293-5db6-4e60-ac9a-8ecee0e06c38]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb, portal: 172.16.0.220,3260]
Aug 27 04:11:42 user nova-compute[72990]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb, portal: 172.16.0.220,3260] successful.
Aug 27 04:11:42 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff91fcd6-a120-4c08-af38-08f6440660fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[244351a1-36f9-4a4a-a7c4-caffcd327a57]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] <== disconnect_volume: return (269ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:11:42 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:11:43 user nova-compute[72990]: DEBUG nova.objects.instance [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:11:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-c6985da2-81fb-4828-91e7-c78482a613b9 tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.688s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:43 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:11:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:43 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:11:43 user nova-compute[72990]: INFO nova.compute.claims [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Claim successful on node user
Aug 27 04:11:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:43 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:44 user nova-compute[72990]: INFO nova.compute.manager [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Detaching volume 5d7acaf3-e00d-4f06-b542-9907c641016a
Aug 27 04:11:44 user nova-compute[72990]: INFO nova.virt.block_device [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Attempting to driver detach volume 5d7acaf3-e00d-4f06-b542-9907c641016a from mountpoint /dev/vdc
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Attempting to detach device vdc from instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:11:44 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:11:44 user nova-compute[72990]:   <source dev="/dev/sde"/>
Aug 27 04:11:44 user nova-compute[72990]:   <target dev="vdc" bus="virtio"/>
Aug 27 04:11:44 user nova-compute[72990]:   <serial>5d7acaf3-e00d-4f06-b542-9907c641016a</serial>
Aug 27 04:11:44 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 04:11:44 user nova-compute[72990]: </disk>
Aug 27 04:11:44 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:11:44 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully detached device vdc from instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 from the persistent domain config.
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:11:44 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:11:44 user nova-compute[72990]:   <source dev="/dev/sde"/>
Aug 27 04:11:44 user nova-compute[72990]:   <target dev="vdc" bus="virtio"/>
Aug 27 04:11:44 user nova-compute[72990]:   <serial>5d7acaf3-e00d-4f06-b542-9907c641016a</serial>
Aug 27 04:11:44 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 04:11:44 user nova-compute[72990]: </disk>
Aug 27 04:11:44 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.network.neutron [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:11:44 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109489.3556435, 213d93d2-14b9-47fc-afb2-568545c6214c => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:11:44 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] VM Stopped (Lifecycle Event)
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.compute.manager [None req-a09342e1-3752-41af-9cef-ff13db17c7a9 None None] [instance: 213d93d2-14b9-47fc-afb2-568545c6214c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:44 user nova-compute[72990]: INFO nova.virt.block_device [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Booting with volume 23922e53-afbc-46e7-bf42-af1a78569fbd at /dev/vda
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.policy [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf3112e616344af7873a50d134260637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6b19a372f947e4aee43f9d7573e8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.utils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f7a8d0-959c-4f8e-8ecb-6a45e7f8b952]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b5ec37-b937-4814-8b13-f568e353d62f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693109504.5280914, 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:11:44 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully detached device vdc from instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 from the live domain config.
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNembpIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:11:44 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f094a050-aabf-4ba5-8564-fe974673b871]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bd205d-091a-4c59-9554-a2fd997381b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6b793b-b96c-42ed-840c-02598ea6a2f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:11:44 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28d7281-12b9-483e-8e98-e76d19e61d16]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.utils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Updating existing volume attachment record: e6919684-5a06-4b09-b200-4311e55e4135 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a0d8ab-4dd8-4570-a20a-d6bfe409a7ef]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:44 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:11:44 user nova-compute[72990]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a (non-flash)
Aug 27 04:11:44 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:11:44 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:11:44 user nova-compute[72990]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a (non-flash)
Aug 27 04:11:44 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f444cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a'): ({'sde'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Removing single pathed devices sde {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[937ff81e-b095-4b71-a3cb-a8852470eb0e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e129235a-55da-4b32-a518-7a2f9141bafc]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Flushing IO for device /dev/sde {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2207139-797f-441f-9f02-4a14a1e3c943]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5089ae76-9b2f-4c07-842f-3cad3a2bd23d]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] SCSI volumes sde have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a650a4f-a64a-46a9-8a78-2713e11ed784]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cdb64b-9469-4e61-9624-3f0a8b927ebc]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a, portal: 172.16.0.220,3260]
Aug 27 04:11:44 user nova-compute[72990]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a, portal: 172.16.0.220,3260] successful.
Aug 27 04:11:44 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7acaf3-e00d-4f06-b542-9907c641016a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49db8d8-9a65-492b-b3f6-505379dafa99]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] <== disconnect_volume: return (323ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:11:44 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG nova.network.neutron [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Successfully created port: eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG nova.objects.instance [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'flavor' on Instance uuid 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-00a6a15a-183e-4137-a236-ef3c853d744b tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.862s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG nova.network.neutron [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Successfully updated port: eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "refresh_cache-7a8653d7-ffad-43fa-81b7-6fd04c67e98c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquired lock "refresh_cache-7a8653d7-ffad-43fa-81b7-6fd04c67e98c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG nova.network.neutron [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG nova.network.neutron [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-70fb8d5e-e53a-4a69-b992-f2f45c453982 req-1bede436-20d1-447e-bb95-e4a9ce6e4a69 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-changed-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG nova.compute.manager [req-70fb8d5e-e53a-4a69-b992-f2f45c453982 req-1bede436-20d1-447e-bb95-e4a9ce6e4a69 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Refreshing instance network info cache due to event network-changed-eee320f3-ed97-4edf-a3c7-91341f5c296a. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:11:45 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-70fb8d5e-e53a-4a69-b992-f2f45c453982 req-1bede436-20d1-447e-bb95-e4a9ce6e4a69 service nova] Acquiring lock "refresh_cache-7a8653d7-ffad-43fa-81b7-6fd04c67e98c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG nova.network.neutron [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Updating instance_info_cache with network_info: [{"id": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "address": "fa:16:3e:17:1e:c0", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee320f3-ed", "ovs_interfaceid": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Releasing lock "refresh_cache-7a8653d7-ffad-43fa-81b7-6fd04c67e98c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Instance network_info: |[{"id": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "address": "fa:16:3e:17:1e:c0", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee320f3-ed", "ovs_interfaceid": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-70fb8d5e-e53a-4a69-b992-f2f45c453982 req-1bede436-20d1-447e-bb95-e4a9ce6e4a69 service nova] Acquired lock "refresh_cache-7a8653d7-ffad-43fa-81b7-6fd04c67e98c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG nova.network.neutron [req-70fb8d5e-e53a-4a69-b992-f2f45c453982 req-1bede436-20d1-447e-bb95-e4a9ce6e4a69 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Refreshing network info cache for port eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:46 user nova-compute[72990]: INFO nova.compute.manager [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Terminating instance
Aug 27 04:11:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] There are 0 instances to clean {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG nova.network.neutron [req-70fb8d5e-e53a-4a69-b992-f2f45c453982 req-1bede436-20d1-447e-bb95-e4a9ce6e4a69 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Updated VIF entry in instance network info cache for port eee320f3-ed97-4edf-a3c7-91341f5c296a. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG nova.network.neutron [req-70fb8d5e-e53a-4a69-b992-f2f45c453982 req-1bede436-20d1-447e-bb95-e4a9ce6e4a69 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Updating instance_info_cache with network_info: [{"id": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "address": "fa:16:3e:17:1e:c0", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee320f3-ed", "ovs_interfaceid": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-70fb8d5e-e53a-4a69-b992-f2f45c453982 req-1bede436-20d1-447e-bb95-e4a9ce6e4a69 service nova] Releasing lock "refresh_cache-7a8653d7-ffad-43fa-81b7-6fd04c67e98c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-b1eaeb46-6f64-45e7-97ad-479d13c5f931 req-5d027d72-4ccc-4f9c-9be0-0ff349b9bf6d service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Received event network-vif-unplugged-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b1eaeb46-6f64-45e7-97ad-479d13c5f931 req-5d027d72-4ccc-4f9c-9be0-0ff349b9bf6d service nova] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b1eaeb46-6f64-45e7-97ad-479d13c5f931 req-5d027d72-4ccc-4f9c-9be0-0ff349b9bf6d service nova] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-b1eaeb46-6f64-45e7-97ad-479d13c5f931 req-5d027d72-4ccc-4f9c-9be0-0ff349b9bf6d service nova] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-b1eaeb46-6f64-45e7-97ad-479d13c5f931 req-5d027d72-4ccc-4f9c-9be0-0ff349b9bf6d service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] No waiting events found dispatching network-vif-unplugged-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:11:46 user nova-compute[72990]: DEBUG nova.compute.manager [req-b1eaeb46-6f64-45e7-97ad-479d13c5f931 req-5d027d72-4ccc-4f9c-9be0-0ff349b9bf6d service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Received event network-vif-unplugged-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:11:47 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Instance destroyed successfully.
Aug 27 04:11:47 user nova-compute[72990]: DEBUG nova.objects.instance [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lazy-loading 'resources' on Instance uuid 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:11:47 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:08:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1859585961',display_name='tempest-AttachVolumeTestJSON-server-1859585961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1859585961',id=45,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqthOOTRdA6D0ha68lyGuRIUkQdWowIedpBt+bSFUR61sjcjpQQYmcLA+C59GnxaZwXTHc+vRL0jq9LAhMALqYppzKE+1+iHD9KCucKfoa2Aes9IICuXr0SwyZtq0JsdQ==',key_name='tempest-keypair-1060503035',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:09:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2d0a8267a0042a0ad831e7b91889dc7',ramdisk_id='',reservation_id='r-e1a1cgx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-698620353',owner_user_name='tempest-AttachVolumeTestJSON-698620353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:09:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5711f5c9c8344de79b246e7eb8661ff2',uuid=8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "address": "fa:16:3e:e9:51:05", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f766b68-0d", "ovs_interfaceid": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:11:47 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converting VIF {"id": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "address": "fa:16:3e:e9:51:05", "network": {"id": "c008f753-4b96-4eb6-8f9a-30c47677a3c3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-53812165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d0a8267a0042a0ad831e7b91889dc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f766b68-0d", "ovs_interfaceid": "6f766b68-0ddc-407e-974f-ef2ef3c8d1ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:11:47 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:51:05,bridge_name='br-int',has_traffic_filtering=True,id=6f766b68-0ddc-407e-974f-ef2ef3c8d1ca,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f766b68-0d') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:11:47 user nova-compute[72990]: DEBUG os_vif [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:51:05,bridge_name='br-int',has_traffic_filtering=True,id=6f766b68-0ddc-407e-974f-ef2ef3c8d1ca,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f766b68-0d') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:11:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f766b68-0d, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:11:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:11:47 user nova-compute[72990]: INFO os_vif [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:51:05,bridge_name='br-int',has_traffic_filtering=True,id=6f766b68-0ddc-407e-974f-ef2ef3c8d1ca,network=Network(c008f753-4b96-4eb6-8f9a-30c47677a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f766b68-0d')
Aug 27 04:11:47 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Deleting instance files /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8_del
Aug 27 04:11:47 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Deletion of /opt/stack/data/nova/instances/8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8_del complete
Aug 27 04:11:47 user nova-compute[72990]: INFO nova.compute.manager [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 27 04:11:47 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:11:47 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:11:47 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:11:48 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:11:48 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Took 0.86 seconds to deallocate network for instance.
Aug 27 04:11:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-aa5172bd-0800-4c87-9723-4fbc10b0296f req-5cc9e1da-089e-4e4c-be6e-347d2206084f service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Received event network-vif-deleted-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:11:48 user nova-compute[72990]: INFO nova.compute.manager [req-aa5172bd-0800-4c87-9723-4fbc10b0296f req-5cc9e1da-089e-4e4c-be6e-347d2206084f service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Neutron deleted interface 6f766b68-0ddc-407e-974f-ef2ef3c8d1ca; detaching it from the instance and deleting it from the info cache
Aug 27 04:11:48 user nova-compute[72990]: DEBUG nova.network.neutron [req-aa5172bd-0800-4c87-9723-4fbc10b0296f req-5cc9e1da-089e-4e4c-be6e-347d2206084f service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:11:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-aa5172bd-0800-4c87-9723-4fbc10b0296f req-5cc9e1da-089e-4e4c-be6e-347d2206084f service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Detach interface failed, port_id=6f766b68-0ddc-407e-974f-ef2ef3c8d1ca, reason: Instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 04:11:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:48 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:11:48 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:11:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:48 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Deleted allocations for instance 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8
Aug 27 04:11:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-8c72155c-a127-4945-8a8d-de4d5f4448ad tempest-AttachVolumeTestJSON-698620353 tempest-AttachVolumeTestJSON-698620353-project-member] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.094s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:48 user nova-compute[72990]: DEBUG nova.compute.manager [req-d05f6353-813f-4fb3-b63c-4f6fc13c1c67 req-a5c0f7d5-5bc8-4388-8eda-e4e629821a07 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Received event network-vif-plugged-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:11:48 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d05f6353-813f-4fb3-b63c-4f6fc13c1c67 req-a5c0f7d5-5bc8-4388-8eda-e4e629821a07 service nova] Acquiring lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d05f6353-813f-4fb3-b63c-4f6fc13c1c67 req-a5c0f7d5-5bc8-4388-8eda-e4e629821a07 service nova] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:49 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d05f6353-813f-4fb3-b63c-4f6fc13c1c67 req-a5c0f7d5-5bc8-4388-8eda-e4e629821a07 service nova] Lock "8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:49 user nova-compute[72990]: DEBUG nova.compute.manager [req-d05f6353-813f-4fb3-b63c-4f6fc13c1c67 req-a5c0f7d5-5bc8-4388-8eda-e4e629821a07 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] No waiting events found dispatching network-vif-plugged-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:11:49 user nova-compute[72990]: WARNING nova.compute.manager [req-d05f6353-813f-4fb3-b63c-4f6fc13c1c67 req-a5c0f7d5-5bc8-4388-8eda-e4e629821a07 service nova] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Received unexpected event network-vif-plugged-6f766b68-0ddc-407e-974f-ef2ef3c8d1ca for instance with vm_state deleted and task_state None.
Aug 27 04:11:50 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:11:51 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:11:51 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:11:51 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:11:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:51 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:11:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:11:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:11:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:11:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:11:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:11:52 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:11:52 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:11:52 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8414MB free_disk=25.07782745361328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:11:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:11:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance b0392f8e-364d-450b-84c7-7b3f631a3a58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance fbba3f29-4b57-43c8-aecd-27e8d3d85c44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7a8653d7-ffad-43fa-81b7-6fd04c67e98c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing inventories for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating ProviderTree inventory for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating inventory in ProviderTree for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing aggregate associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, aggregates: None {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing trait associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:11:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:11:54 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:11:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:11:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:11:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Skipping network cache update for instance because it is Building. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 04:11:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:11:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:11:54 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:11:54 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid b0392f8e-364d-450b-84c7-7b3f631a3a58 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:11:55 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updating instance_info_cache with network_info: [{"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:11:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:11:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:11:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:11:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:11:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:12:02 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109507.3380437, 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:12:02 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] VM Stopped (Lifecycle Event)
Aug 27 04:12:02 user nova-compute[72990]: DEBUG nova.compute.manager [None req-e964a962-c700-463f-a3f1-c2017fa1788f None None] [instance: 8f6b0cc5-78b6-4f2d-9cec-661c6a49faa8] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:12:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:12:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:12:16 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Creating image(s)
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Ensure instance console log exists: /opt/stack/data/nova/instances/7a8653d7-ffad-43fa-81b7-6fd04c67e98c/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Start _get_guest_xml network_info=[{"id": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "address": "fa:16:3e:17:1e:c0", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee320f3-ed", "ovs_interfaceid": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'e6919684-5a06-4b09-b200-4311e55e4135', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhJcfbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7a8653d7-ffad-43fa-81b7-6fd04c67e98c', 'attached_at': '', 'detached_at': '', 'volume_id': '23922e53-afbc-46e7-bf42-af1a78569fbd', 'serial': '23922e53-afbc-46e7-bf42-af1a78569fbd'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:12:16 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:12:16 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhJcfbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:12:16 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:12:16 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:12:16 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10b81d9-1ac2-4a2a-af65-82b0012d57cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:12:16 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9291be89-7103-40d0-ad78-eb3bb54f2851]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd] added
Aug 27 04:12:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[359934f2-bac5-4526-a419-2a83c14769c1]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73d37a9-2f1a-4f20-ac8a-a7621dc13f12]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDhJcfbs {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDhJcfbs" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2157063d-fae7-43e8-aa50-4e509abac193]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BDhJcfbs'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5f291-8072-491e-95d3-17015d9c7060]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af2b64e-8fc8-4fc7-9b70-6a35065a575f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:12:16 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:12:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:12:16 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:12:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccd6d9c-6fa5-4398-ac0b-6cd084b16a10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260]
Aug 27 04:12:16 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260] successful.
Aug 27 04:12:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae2db3f-5555-46a6-a16a-0d48c9834a02]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b594e38f-f3bd-4f27-84fc-97636a8325af]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:12:16 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:12:16 user nova-compute[72990]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:12:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:12:16 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:12:16 user nova-compute[72990]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:12:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[35889756-d3cd-4010-982b-880af1b8f777]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhJcfbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:12:16 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72990) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23761623534346337', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761623534346337', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-419855681',display_name='tempest-TestVolumeBootPattern-server-419855681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-419855681',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAxiq8nzDuLrhlX90KCpMhjjdu00EEsfsUBjmDNf2QVNBgoIetJr5kJSGJfbGHc1lKfJ77a4En5IQ+5dvysFKDT9aLp7EGC0j0/Z1Ri5VH2ji/z9XR9yuImUkcGl95llA==',key_name='tempest-TestVolumeBootPattern-1921423690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-iyzrp7wb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:11:44Z,user_data=None,user_id='cf3112e616344af7873a50d134260637',uuid=7a8653d7-ffad-43fa-81b7-6fd04c67e98c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "address": "fa:16:3e:17:1e:c0", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee320f3-ed", "ovs_interfaceid": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "address": "fa:16:3e:17:1e:c0", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee320f3-ed", "ovs_interfaceid": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:1e:c0,bridge_name='br-int',has_traffic_filtering=True,id=eee320f3-ed97-4edf-a3c7-91341f5c296a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeee320f3-ed') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG nova.objects.instance [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a8653d7-ffad-43fa-81b7-6fd04c67e98c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:12:17 user nova-compute[72990]:   <uuid>7a8653d7-ffad-43fa-81b7-6fd04c67e98c</uuid>
Aug 27 04:12:17 user nova-compute[72990]:   <name>instance-00000030</name>
Aug 27 04:12:17 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:12:17 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:12:17 user nova-compute[72990]:   <metadata>
Aug 27 04:12:17 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:12:17 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:12:17 user nova-compute[72990]:       <nova:name>tempest-TestVolumeBootPattern-server-419855681</nova:name>
Aug 27 04:12:17 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:12:16</nova:creationTime>
Aug 27 04:12:17 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:12:17 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:12:17 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:12:17 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:12:17 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:12:17 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:12:17 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:12:17 user nova-compute[72990]:       <nova:owner>
Aug 27 04:12:17 user nova-compute[72990]:         <nova:user uuid="cf3112e616344af7873a50d134260637">tempest-TestVolumeBootPattern-1834919775-project-member</nova:user>
Aug 27 04:12:17 user nova-compute[72990]:         <nova:project uuid="6d6b19a372f947e4aee43f9d7573e8f7">tempest-TestVolumeBootPattern-1834919775</nova:project>
Aug 27 04:12:17 user nova-compute[72990]:       </nova:owner>
Aug 27 04:12:17 user nova-compute[72990]:       <nova:ports>
Aug 27 04:12:17 user nova-compute[72990]:         <nova:port uuid="eee320f3-ed97-4edf-a3c7-91341f5c296a">
Aug 27 04:12:17 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 04:12:17 user nova-compute[72990]:         </nova:port>
Aug 27 04:12:17 user nova-compute[72990]:       </nova:ports>
Aug 27 04:12:17 user nova-compute[72990]:     </nova:instance>
Aug 27 04:12:17 user nova-compute[72990]:   </metadata>
Aug 27 04:12:17 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:12:17 user nova-compute[72990]:     <system>
Aug 27 04:12:17 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:12:17 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:12:17 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:12:17 user nova-compute[72990]:       <entry name="serial">7a8653d7-ffad-43fa-81b7-6fd04c67e98c</entry>
Aug 27 04:12:17 user nova-compute[72990]:       <entry name="uuid">7a8653d7-ffad-43fa-81b7-6fd04c67e98c</entry>
Aug 27 04:12:17 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:12:17 user nova-compute[72990]:     </system>
Aug 27 04:12:17 user nova-compute[72990]:   </sysinfo>
Aug 27 04:12:17 user nova-compute[72990]:   <os>
Aug 27 04:12:17 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:12:17 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:12:17 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:12:17 user nova-compute[72990]:   </os>
Aug 27 04:12:17 user nova-compute[72990]:   <features>
Aug 27 04:12:17 user nova-compute[72990]:     <acpi/>
Aug 27 04:12:17 user nova-compute[72990]:     <apic/>
Aug 27 04:12:17 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:12:17 user nova-compute[72990]:   </features>
Aug 27 04:12:17 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:12:17 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:12:17 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:12:17 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:12:17 user nova-compute[72990]:   </clock>
Aug 27 04:12:17 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:12:17 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:12:17 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:12:17 user nova-compute[72990]:   </cpu>
Aug 27 04:12:17 user nova-compute[72990]:   <devices>
Aug 27 04:12:17 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 04:12:17 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:12:17 user nova-compute[72990]:       <source dev="/dev/sdb"/>
Aug 27 04:12:17 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:12:17 user nova-compute[72990]:       <serial>23922e53-afbc-46e7-bf42-af1a78569fbd</serial>
Aug 27 04:12:17 user nova-compute[72990]:     </disk>
Aug 27 04:12:17 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:12:17 user nova-compute[72990]:       <mac address="fa:16:3e:17:1e:c0"/>
Aug 27 04:12:17 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:12:17 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:12:17 user nova-compute[72990]:       <target dev="tapeee320f3-ed"/>
Aug 27 04:12:17 user nova-compute[72990]:     </interface>
Aug 27 04:12:17 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:12:17 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/7a8653d7-ffad-43fa-81b7-6fd04c67e98c/console.log" append="off"/>
Aug 27 04:12:17 user nova-compute[72990]:     </serial>
Aug 27 04:12:17 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:12:17 user nova-compute[72990]:     <video>
Aug 27 04:12:17 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:12:17 user nova-compute[72990]:     </video>
Aug 27 04:12:17 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:12:17 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:12:17 user nova-compute[72990]:     </rng>
Aug 27 04:12:17 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:12:17 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:12:17 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:12:17 user nova-compute[72990]:     </memballoon>
Aug 27 04:12:17 user nova-compute[72990]:   </devices>
Aug 27 04:12:17 user nova-compute[72990]: </domain>
Aug 27 04:12:17 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-419855681',display_name='tempest-TestVolumeBootPattern-server-419855681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-419855681',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAxiq8nzDuLrhlX90KCpMhjjdu00EEsfsUBjmDNf2QVNBgoIetJr5kJSGJfbGHc1lKfJ77a4En5IQ+5dvysFKDT9aLp7EGC0j0/Z1Ri5VH2ji/z9XR9yuImUkcGl95llA==',key_name='tempest-TestVolumeBootPattern-1921423690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-iyzrp7wb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:11:44Z,user_data=None,user_id='cf3112e616344af7873a50d134260637',uuid=7a8653d7-ffad-43fa-81b7-6fd04c67e98c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "address": "fa:16:3e:17:1e:c0", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee320f3-ed", "ovs_interfaceid": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "address": "fa:16:3e:17:1e:c0", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee320f3-ed", "ovs_interfaceid": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:1e:c0,bridge_name='br-int',has_traffic_filtering=True,id=eee320f3-ed97-4edf-a3c7-91341f5c296a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeee320f3-ed') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG os_vif [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:1e:c0,bridge_name='br-int',has_traffic_filtering=True,id=eee320f3-ed97-4edf-a3c7-91341f5c296a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeee320f3-ed') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeee320f3-ed, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeee320f3-ed, col_values=(('external_ids', {'iface-id': 'eee320f3-ed97-4edf-a3c7-91341f5c296a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:1e:c0', 'vm-uuid': '7a8653d7-ffad-43fa-81b7-6fd04c67e98c'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:17 user nova-compute[72990]: INFO os_vif [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:1e:c0,bridge_name='br-int',has_traffic_filtering=True,id=eee320f3-ed97-4edf-a3c7-91341f5c296a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeee320f3-ed')
Aug 27 04:12:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:12:17 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] No VIF found with MAC fa:16:3e:17:1e:c0, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:12:18 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:12:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:19 user nova-compute[72990]: DEBUG nova.compute.manager [req-d8e9856b-7b58-4e3a-bf71-c8eb564a14af req-a4fd3816-7a41-487a-b397-b7e5437c82b8 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:12:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d8e9856b-7b58-4e3a-bf71-c8eb564a14af req-a4fd3816-7a41-487a-b397-b7e5437c82b8 service nova] Acquiring lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d8e9856b-7b58-4e3a-bf71-c8eb564a14af req-a4fd3816-7a41-487a-b397-b7e5437c82b8 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:19 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d8e9856b-7b58-4e3a-bf71-c8eb564a14af req-a4fd3816-7a41-487a-b397-b7e5437c82b8 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:19 user nova-compute[72990]: DEBUG nova.compute.manager [req-d8e9856b-7b58-4e3a-bf71-c8eb564a14af req-a4fd3816-7a41-487a-b397-b7e5437c82b8 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] No waiting events found dispatching network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:12:19 user nova-compute[72990]: WARNING nova.compute.manager [req-d8e9856b-7b58-4e3a-bf71-c8eb564a14af req-a4fd3816-7a41-487a-b397-b7e5437c82b8 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received unexpected event network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a for instance with vm_state building and task_state spawning.
Aug 27 04:12:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:19 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "49de835f-41fb-4ba5-97cc-bfc1867290b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:12:20 user nova-compute[72990]: INFO nova.compute.claims [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Claim successful on node user
Aug 27 04:12:20 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:12:20 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:12:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG nova.policy [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12f4f79d69a147568e4e0a44ffbf6591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161e68b849ab44c1bd68f134d620add6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:12:20 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Creating image(s)
Aug 27 04:12:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "/opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "/opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "/opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109541.132235, 7a8653d7-ffad-43fa-81b7-6fd04c67e98c => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:12:21 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] VM Resumed (Lifecycle Event)
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.199s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.compute.manager [req-70dbe528-99b1-4aaf-87c5-c8aeb9c6c989 req-c2a8aaed-2e64-4f64-bad8-296483978991 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-70dbe528-99b1-4aaf-87c5-c8aeb9c6c989 req-c2a8aaed-2e64-4f64-bad8-296483978991 service nova] Acquiring lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-70dbe528-99b1-4aaf-87c5-c8aeb9c6c989 req-c2a8aaed-2e64-4f64-bad8-296483978991 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-70dbe528-99b1-4aaf-87c5-c8aeb9c6c989 req-c2a8aaed-2e64-4f64-bad8-296483978991 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.compute.manager [req-70dbe528-99b1-4aaf-87c5-c8aeb9c6c989 req-c2a8aaed-2e64-4f64-bad8-296483978991 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] No waiting events found dispatching network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:12:21 user nova-compute[72990]: WARNING nova.compute.manager [req-70dbe528-99b1-4aaf-87c5-c8aeb9c6c989 req-c2a8aaed-2e64-4f64-bad8-296483978991 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received unexpected event network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a for instance with vm_state building and task_state spawning.
Aug 27 04:12:21 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Instance spawned successfully.
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:12:21 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109541.1327317, 7a8653d7-ffad-43fa-81b7-6fd04c67e98c => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:12:21 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] VM Started (Lifecycle Event)
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:21 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:12:21 user nova-compute[72990]: INFO nova.compute.manager [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Took 5.29 seconds to spawn the instance on the hypervisor.
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.compute.manager [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk 1073741824" returned: 0 in 0.068s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Successfully created port: b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:12:21 user nova-compute[72990]: INFO nova.compute.manager [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Took 37.65 seconds to build instance.
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-ddc662d9-d585-420b-a410-0f9f2a6dfec2 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.763s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.207s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Cannot resize image /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Ensure instance console log exists: /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Successfully updated port: b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "refresh_cache-49de835f-41fb-4ba5-97cc-bfc1867290b0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquired lock "refresh_cache-49de835f-41fb-4ba5-97cc-bfc1867290b0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.compute.manager [req-1b139e33-869b-4ce6-ac7e-f50b16e8681d req-b6ebcf39-57e7-4fca-ac4a-fa1653f51d40 service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Received event network-changed-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.compute.manager [req-1b139e33-869b-4ce6-ac7e-f50b16e8681d req-b6ebcf39-57e7-4fca-ac4a-fa1653f51d40 service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Refreshing instance network info cache due to event network-changed-b43d81f2-cbd2-448f-b2b3-59d31ae294b3. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1b139e33-869b-4ce6-ac7e-f50b16e8681d req-b6ebcf39-57e7-4fca-ac4a-fa1653f51d40 service nova] Acquiring lock "refresh_cache-49de835f-41fb-4ba5-97cc-bfc1867290b0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Updating instance_info_cache with network_info: [{"id": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "address": "fa:16:3e:f5:a9:04", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb43d81f2-cb", "ovs_interfaceid": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Releasing lock "refresh_cache-49de835f-41fb-4ba5-97cc-bfc1867290b0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Instance network_info: |[{"id": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "address": "fa:16:3e:f5:a9:04", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb43d81f2-cb", "ovs_interfaceid": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1b139e33-869b-4ce6-ac7e-f50b16e8681d req-b6ebcf39-57e7-4fca-ac4a-fa1653f51d40 service nova] Acquired lock "refresh_cache-49de835f-41fb-4ba5-97cc-bfc1867290b0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.network.neutron [req-1b139e33-869b-4ce6-ac7e-f50b16e8681d req-b6ebcf39-57e7-4fca-ac4a-fa1653f51d40 service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Refreshing network info cache for port b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Start _get_guest_xml network_info=[{"id": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "address": "fa:16:3e:f5:a9:04", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb43d81f2-cb", "ovs_interfaceid": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:12:22 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:12:22 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:12:22 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1067143970',display_name='tempest-VolumesActionsTest-instance-1067143970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1067143970',id=49,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='161e68b849ab44c1bd68f134d620add6',ramdisk_id='',reservation_id='r-zle32wpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1193624458',owner_user_name='tempest-VolumesActionsTest-1193624458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:12:21Z,user_data=None,user_id='12f4f79d69a147568e4e0a44ffbf6591',uuid=49de835f-41fb-4ba5-97cc-bfc1867290b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "address": "fa:16:3e:f5:a9:04", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb43d81f2-cb", "ovs_interfaceid": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Converting VIF {"id": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "address": "fa:16:3e:f5:a9:04", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb43d81f2-cb", "ovs_interfaceid": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:04,bridge_name='br-int',has_traffic_filtering=True,id=b43d81f2-cbd2-448f-b2b3-59d31ae294b3,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb43d81f2-cb') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG nova.objects.instance [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lazy-loading 'pci_devices' on Instance uuid 49de835f-41fb-4ba5-97cc-bfc1867290b0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:12:23 user nova-compute[72990]:   <uuid>49de835f-41fb-4ba5-97cc-bfc1867290b0</uuid>
Aug 27 04:12:23 user nova-compute[72990]:   <name>instance-00000031</name>
Aug 27 04:12:23 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:12:23 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:12:23 user nova-compute[72990]:   <metadata>
Aug 27 04:12:23 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:12:23 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:12:23 user nova-compute[72990]:       <nova:name>tempest-VolumesActionsTest-instance-1067143970</nova:name>
Aug 27 04:12:23 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:12:22</nova:creationTime>
Aug 27 04:12:23 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:12:23 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:12:23 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:12:23 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:12:23 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:12:23 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:12:23 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:12:23 user nova-compute[72990]:       <nova:owner>
Aug 27 04:12:23 user nova-compute[72990]:         <nova:user uuid="12f4f79d69a147568e4e0a44ffbf6591">tempest-VolumesActionsTest-1193624458-project-member</nova:user>
Aug 27 04:12:23 user nova-compute[72990]:         <nova:project uuid="161e68b849ab44c1bd68f134d620add6">tempest-VolumesActionsTest-1193624458</nova:project>
Aug 27 04:12:23 user nova-compute[72990]:       </nova:owner>
Aug 27 04:12:23 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 04:12:23 user nova-compute[72990]:       <nova:ports>
Aug 27 04:12:23 user nova-compute[72990]:         <nova:port uuid="b43d81f2-cbd2-448f-b2b3-59d31ae294b3">
Aug 27 04:12:23 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 04:12:23 user nova-compute[72990]:         </nova:port>
Aug 27 04:12:23 user nova-compute[72990]:       </nova:ports>
Aug 27 04:12:23 user nova-compute[72990]:     </nova:instance>
Aug 27 04:12:23 user nova-compute[72990]:   </metadata>
Aug 27 04:12:23 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:12:23 user nova-compute[72990]:     <system>
Aug 27 04:12:23 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:12:23 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:12:23 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:12:23 user nova-compute[72990]:       <entry name="serial">49de835f-41fb-4ba5-97cc-bfc1867290b0</entry>
Aug 27 04:12:23 user nova-compute[72990]:       <entry name="uuid">49de835f-41fb-4ba5-97cc-bfc1867290b0</entry>
Aug 27 04:12:23 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:12:23 user nova-compute[72990]:     </system>
Aug 27 04:12:23 user nova-compute[72990]:   </sysinfo>
Aug 27 04:12:23 user nova-compute[72990]:   <os>
Aug 27 04:12:23 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:12:23 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:12:23 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:12:23 user nova-compute[72990]:   </os>
Aug 27 04:12:23 user nova-compute[72990]:   <features>
Aug 27 04:12:23 user nova-compute[72990]:     <acpi/>
Aug 27 04:12:23 user nova-compute[72990]:     <apic/>
Aug 27 04:12:23 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:12:23 user nova-compute[72990]:   </features>
Aug 27 04:12:23 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:12:23 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:12:23 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:12:23 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:12:23 user nova-compute[72990]:   </clock>
Aug 27 04:12:23 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:12:23 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:12:23 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:12:23 user nova-compute[72990]:   </cpu>
Aug 27 04:12:23 user nova-compute[72990]:   <devices>
Aug 27 04:12:23 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:12:23 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:12:23 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk"/>
Aug 27 04:12:23 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:12:23 user nova-compute[72990]:     </disk>
Aug 27 04:12:23 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:12:23 user nova-compute[72990]:       <mac address="fa:16:3e:f5:a9:04"/>
Aug 27 04:12:23 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:12:23 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:12:23 user nova-compute[72990]:       <target dev="tapb43d81f2-cb"/>
Aug 27 04:12:23 user nova-compute[72990]:     </interface>
Aug 27 04:12:23 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:12:23 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/console.log" append="off"/>
Aug 27 04:12:23 user nova-compute[72990]:     </serial>
Aug 27 04:12:23 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:12:23 user nova-compute[72990]:     <video>
Aug 27 04:12:23 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:12:23 user nova-compute[72990]:     </video>
Aug 27 04:12:23 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:12:23 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:12:23 user nova-compute[72990]:     </rng>
Aug 27 04:12:23 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:12:23 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:12:23 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:12:23 user nova-compute[72990]:     </memballoon>
Aug 27 04:12:23 user nova-compute[72990]:   </devices>
Aug 27 04:12:23 user nova-compute[72990]: </domain>
Aug 27 04:12:23 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1067143970',display_name='tempest-VolumesActionsTest-instance-1067143970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1067143970',id=49,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='161e68b849ab44c1bd68f134d620add6',ramdisk_id='',reservation_id='r-zle32wpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1193624458',owner_user_name='tempest-VolumesActionsTest-1193624458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:12:21Z,user_data=None,user_id='12f4f79d69a147568e4e0a44ffbf6591',uuid=49de835f-41fb-4ba5-97cc-bfc1867290b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "address": "fa:16:3e:f5:a9:04", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb43d81f2-cb", "ovs_interfaceid": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Converting VIF {"id": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "address": "fa:16:3e:f5:a9:04", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb43d81f2-cb", "ovs_interfaceid": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:04,bridge_name='br-int',has_traffic_filtering=True,id=b43d81f2-cbd2-448f-b2b3-59d31ae294b3,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb43d81f2-cb') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG os_vif [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:04,bridge_name='br-int',has_traffic_filtering=True,id=b43d81f2-cbd2-448f-b2b3-59d31ae294b3,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb43d81f2-cb') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb43d81f2-cb, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb43d81f2-cb, col_values=(('external_ids', {'iface-id': 'b43d81f2-cbd2-448f-b2b3-59d31ae294b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:a9:04', 'vm-uuid': '49de835f-41fb-4ba5-97cc-bfc1867290b0'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:23 user nova-compute[72990]: INFO os_vif [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:04,bridge_name='br-int',has_traffic_filtering=True,id=b43d81f2-cbd2-448f-b2b3-59d31ae294b3,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb43d81f2-cb')
Aug 27 04:12:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] No VIF found with MAC fa:16:3e:f5:a9:04, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG nova.network.neutron [req-1b139e33-869b-4ce6-ac7e-f50b16e8681d req-b6ebcf39-57e7-4fca-ac4a-fa1653f51d40 service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Updated VIF entry in instance network info cache for port b43d81f2-cbd2-448f-b2b3-59d31ae294b3. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG nova.network.neutron [req-1b139e33-869b-4ce6-ac7e-f50b16e8681d req-b6ebcf39-57e7-4fca-ac4a-fa1653f51d40 service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Updating instance_info_cache with network_info: [{"id": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "address": "fa:16:3e:f5:a9:04", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb43d81f2-cb", "ovs_interfaceid": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-1b139e33-869b-4ce6-ac7e-f50b16e8681d req-b6ebcf39-57e7-4fca-ac4a-fa1653f51d40 service nova] Releasing lock "refresh_cache-49de835f-41fb-4ba5-97cc-bfc1867290b0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:23 user nova-compute[72990]: INFO nova.compute.manager [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Detaching volume 1d4473e7-4ada-4c14-9f06-7be6222c1006
Aug 27 04:12:23 user nova-compute[72990]: INFO nova.virt.block_device [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Attempting to driver detach volume 1d4473e7-4ada-4c14-9f06-7be6222c1006 from mountpoint /dev/vdb
Aug 27 04:12:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Attempting to detach device vdb from instance fbba3f29-4b57-43c8-aecd-27e8d3d85c44 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:12:24 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:12:24 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 04:12:24 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:12:24 user nova-compute[72990]:   <serial>1d4473e7-4ada-4c14-9f06-7be6222c1006</serial>
Aug 27 04:12:24 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:12:24 user nova-compute[72990]: </disk>
Aug 27 04:12:24 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:12:24 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Successfully detached device vdb from instance fbba3f29-4b57-43c8-aecd-27e8d3d85c44 from the persistent domain config.
Aug 27 04:12:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fbba3f29-4b57-43c8-aecd-27e8d3d85c44 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:12:24 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:12:24 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 04:12:24 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:12:24 user nova-compute[72990]:   <serial>1d4473e7-4ada-4c14-9f06-7be6222c1006</serial>
Aug 27 04:12:24 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:12:24 user nova-compute[72990]: </disk>
Aug 27 04:12:24 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG nova.compute.manager [req-ff8754bd-a2ad-4a0f-b238-f1e3de36c547 req-ce936c92-d2b3-4737-b0f0-46830a570182 service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Received event network-vif-plugged-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ff8754bd-a2ad-4a0f-b238-f1e3de36c547 req-ce936c92-d2b3-4737-b0f0-46830a570182 service nova] Acquiring lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ff8754bd-a2ad-4a0f-b238-f1e3de36c547 req-ce936c92-d2b3-4737-b0f0-46830a570182 service nova] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ff8754bd-a2ad-4a0f-b238-f1e3de36c547 req-ce936c92-d2b3-4737-b0f0-46830a570182 service nova] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG nova.compute.manager [req-ff8754bd-a2ad-4a0f-b238-f1e3de36c547 req-ce936c92-d2b3-4737-b0f0-46830a570182 service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] No waiting events found dispatching network-vif-plugged-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:12:24 user nova-compute[72990]: WARNING nova.compute.manager [req-ff8754bd-a2ad-4a0f-b238-f1e3de36c547 req-ce936c92-d2b3-4737-b0f0-46830a570182 service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Received unexpected event network-vif-plugged-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 for instance with vm_state building and task_state spawning.
Aug 27 04:12:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693109544.7806206, fbba3f29-4b57-43c8-aecd-27e8d3d85c44 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fbba3f29-4b57-43c8-aecd-27e8d3d85c44 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:12:24 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Successfully detached device vdb from instance fbba3f29-4b57-43c8-aecd-27e8d3d85c44 from the live domain config.
Aug 27 04:12:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UciOSWQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:12:24 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b1a9e8-a33a-4d50-be8e-fcb0adf6fe86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a97cac-56cd-46a8-bd89-35908fd67eaa]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:12:24 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:12:24 user nova-compute[72990]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:12:24 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:12:24 user nova-compute[72990]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 (non-flash)
Aug 27 04:12:24 user nova-compute[72990]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:12:24 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7236d97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006'): ({'sdd'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Removing single pathed devices sdd {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41f9eb7-f6e7-421e-a4a2-45344c4fd5ad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[203f9cc0-af6e-4eaf-a41d-54118ba5ef26]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Flushing IO for device /dev/sdd {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4a4a20-c4b8-4138-9637-c8e9c13fe87a]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca986a36-7b75-48a4-b66e-77e38270097f]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:12:24 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[60163dd3-3605-4330-b5bf-b949e2728d5e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[780b83ab-52e2-41a5-9ffe-2a42c286d81b]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006, portal: 172.16.0.220,3260]
Aug 27 04:12:25 user nova-compute[72990]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006, portal: 172.16.0.220,3260] successful.
Aug 27 04:12:25 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3120f820-b95c-4fd5-8f60-2b2f9512319c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] <== disconnect_volume: return (325ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG nova.objects.instance [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lazy-loading 'flavor' on Instance uuid fbba3f29-4b57-43c8-aecd-27e8d3d85c44 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-6ed74521-4e5c-4342-a9f6-8061462901de req-f09dbf44-6364-4a2c-9980-dfd1a2ae4755 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-changed-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-6ed74521-4e5c-4342-a9f6-8061462901de req-f09dbf44-6364-4a2c-9980-dfd1a2ae4755 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Refreshing instance network info cache due to event network-changed-04dc6ccc-6386-4870-86a2-2cfd0973ec3a. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6ed74521-4e5c-4342-a9f6-8061462901de req-f09dbf44-6364-4a2c-9980-dfd1a2ae4755 service nova] Acquiring lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6ed74521-4e5c-4342-a9f6-8061462901de req-f09dbf44-6364-4a2c-9980-dfd1a2ae4755 service nova] Acquired lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG nova.network.neutron [req-6ed74521-4e5c-4342-a9f6-8061462901de req-f09dbf44-6364-4a2c-9980-dfd1a2ae4755 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Refreshing network info cache for port 04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-00742c64-239c-40ed-8358-498567b7993f tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.224s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.070s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:26 user nova-compute[72990]: INFO nova.compute.manager [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Terminating instance
Aug 27 04:12:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-d2ca79f2-2dbb-4a64-946d-d15480c90c13 req-6adfb67b-9857-41c2-8d7c-c753885f5d32 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Received event network-vif-unplugged-0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d2ca79f2-2dbb-4a64-946d-d15480c90c13 req-6adfb67b-9857-41c2-8d7c-c753885f5d32 service nova] Acquiring lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d2ca79f2-2dbb-4a64-946d-d15480c90c13 req-6adfb67b-9857-41c2-8d7c-c753885f5d32 service nova] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-d2ca79f2-2dbb-4a64-946d-d15480c90c13 req-6adfb67b-9857-41c2-8d7c-c753885f5d32 service nova] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-d2ca79f2-2dbb-4a64-946d-d15480c90c13 req-6adfb67b-9857-41c2-8d7c-c753885f5d32 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] No waiting events found dispatching network-vif-unplugged-0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-d2ca79f2-2dbb-4a64-946d-d15480c90c13 req-6adfb67b-9857-41c2-8d7c-c753885f5d32 service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Received event network-vif-unplugged-0498f2e1-b488-4c8b-90f6-51343e41b0df for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-149aa946-5139-42d0-b5a8-438387998e35 req-dc4b3f70-8b65-4d1f-b64b-9b36064020d2 service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Received event network-vif-plugged-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-149aa946-5139-42d0-b5a8-438387998e35 req-dc4b3f70-8b65-4d1f-b64b-9b36064020d2 service nova] Acquiring lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-149aa946-5139-42d0-b5a8-438387998e35 req-dc4b3f70-8b65-4d1f-b64b-9b36064020d2 service nova] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-149aa946-5139-42d0-b5a8-438387998e35 req-dc4b3f70-8b65-4d1f-b64b-9b36064020d2 service nova] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-149aa946-5139-42d0-b5a8-438387998e35 req-dc4b3f70-8b65-4d1f-b64b-9b36064020d2 service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] No waiting events found dispatching network-vif-plugged-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:12:26 user nova-compute[72990]: WARNING nova.compute.manager [req-149aa946-5139-42d0-b5a8-438387998e35 req-dc4b3f70-8b65-4d1f-b64b-9b36064020d2 service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Received unexpected event network-vif-plugged-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 for instance with vm_state building and task_state spawning.
Aug 27 04:12:26 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Instance destroyed successfully.
Aug 27 04:12:26 user nova-compute[72990]: DEBUG nova.objects.instance [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lazy-loading 'resources' on Instance uuid fbba3f29-4b57-43c8-aecd-27e8d3d85c44 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1017785174',display_name='tempest-VolumesSnapshotTestJSON-instance-1017785174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1017785174',id=46,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMRtRL7Ih67Hz0tHnMbo0u4g7Lev/1zGTg8xsuEytPXKYOyMTulaPbHa0tvNM3BfWMIFmM63jqI4Kg+CO3KAsv2k+bf2FnKsPsAs65s1HA9DcaYtPTV38WFMCTM/7Fr0w==',key_name='tempest-keypair-1774246484',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:09:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='672e3e9fbb0844ada56ef6b665212fb0',ramdisk_id='',reservation_id='r-v9bh09fp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1409906536',owner_user_name='tempest-VolumesSnapshotTestJSON-1409906536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:09:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bc7642afe894fea911c5bd6250e436f',uuid=fbba3f29-4b57-43c8-aecd-27e8d3d85c44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "address": "fa:16:3e:05:61:fa", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0498f2e1-b4", "ovs_interfaceid": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Converting VIF {"id": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "address": "fa:16:3e:05:61:fa", "network": {"id": "999769c2-92a7-459a-a715-4728af6e1e61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-385921549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672e3e9fbb0844ada56ef6b665212fb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0498f2e1-b4", "ovs_interfaceid": "0498f2e1-b488-4c8b-90f6-51343e41b0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:61:fa,bridge_name='br-int',has_traffic_filtering=True,id=0498f2e1-b488-4c8b-90f6-51343e41b0df,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0498f2e1-b4') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_vif [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:61:fa,bridge_name='br-int',has_traffic_filtering=True,id=0498f2e1-b488-4c8b-90f6-51343e41b0df,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0498f2e1-b4') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0498f2e1-b4, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:12:27 user nova-compute[72990]: INFO os_vif [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:61:fa,bridge_name='br-int',has_traffic_filtering=True,id=0498f2e1-b488-4c8b-90f6-51343e41b0df,network=Network(999769c2-92a7-459a-a715-4728af6e1e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0498f2e1-b4')
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UciOSWQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:12:27 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d4473e7-4ada-4c14-9f06-7be6222c1006', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[525bc7b2-8783-4258-95bc-65a380828564]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e008f39c-e653-458f-93a6-283d8a7e43bf]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:12:27 user nova-compute[72990]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:12:27 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:12:27 user nova-compute[72990]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:12:27 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7237e2ef0>, {}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Disconnecting from: [] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] <== disconnect_volume: return (64ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Deleting instance files /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44_del
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Deletion of /opt/stack/data/nova/instances/fbba3f29-4b57-43c8-aecd-27e8d3d85c44_del complete
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.compute.manager [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 27 04:12:27 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109547.2443655, 49de835f-41fb-4ba5-97cc-bfc1867290b0 => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] VM Resumed (Lifecycle Event)
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Instance spawned successfully.
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109547.246328, 49de835f-41fb-4ba5-97cc-bfc1867290b0 => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] VM Started (Lifecycle Event)
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.compute.manager [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Detaching volume 5d7ec106-48e7-483d-9504-4944bf99ba25
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.compute.manager [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.virt.block_device [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Attempting to driver detach volume 5d7ec106-48e7-483d-9504-4944bf99ba25 from mountpoint /dev/vdb
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Attempting to detach device vdb from instance b0392f8e-364d-450b-84c7-7b3f631a3a58 from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:12:27 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:12:27 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 04:12:27 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:12:27 user nova-compute[72990]:   <serial>5d7ec106-48e7-483d-9504-4944bf99ba25</serial>
Aug 27 04:12:27 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:12:27 user nova-compute[72990]: </disk>
Aug 27 04:12:27 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Successfully detached device vdb from instance b0392f8e-364d-450b-84c7-7b3f631a3a58 from the persistent domain config.
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b0392f8e-364d-450b-84c7-7b3f631a3a58 from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:12:27 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:12:27 user nova-compute[72990]:   <source dev="/dev/sdc"/>
Aug 27 04:12:27 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:12:27 user nova-compute[72990]:   <serial>5d7ec106-48e7-483d-9504-4944bf99ba25</serial>
Aug 27 04:12:27 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:12:27 user nova-compute[72990]: </disk>
Aug 27 04:12:27 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.compute.manager [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Took 7.06 seconds to build instance.
Aug 27 04:12:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-d66d2d51-0935-4bdb-8f73-4765a88b2016 tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.147s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.network.neutron [req-6ed74521-4e5c-4342-a9f6-8061462901de req-f09dbf44-6364-4a2c-9980-dfd1a2ae4755 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updated VIF entry in instance network info cache for port 04dc6ccc-6386-4870-86a2-2cfd0973ec3a. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.network.neutron [req-6ed74521-4e5c-4342-a9f6-8061462901de req-f09dbf44-6364-4a2c-9980-dfd1a2ae4755 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updating instance_info_cache with network_info: [{"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-6ed74521-4e5c-4342-a9f6-8061462901de req-f09dbf44-6364-4a2c-9980-dfd1a2ae4755 service nova] Releasing lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693109547.959218, b0392f8e-364d-450b-84c7-7b3f631a3a58 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b0392f8e-364d-450b-84c7-7b3f631a3a58 {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:12:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Successfully detached device vdb from instance b0392f8e-364d-450b-84c7-7b3f631a3a58 from the live domain config.
Aug 27 04:12:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bZYKVlzo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:12:27 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:12:27 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b7b2c0-c62f-44d1-89d5-741ef553e875]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ae9ec2-dc16-423c-ac1b-ebb6c0160baa]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:12:28 user nova-compute[72990]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:12:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 (non-flash)
Aug 27 04:12:28 user nova-compute[72990]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:12:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4161750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[16133abc-61e5-4efd-8ab9-9ce0d372bcf9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6d5ead-7343-48f6-852d-c7ae6d95ee70]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8146afaf-24d0-4d8d-b0a4-8229891be9b6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a2d86f-fe23-4450-bd42-3c25ee948e1e]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06b6209-9b0f-4dae-9a6b-fc5a31d6e478]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adf6a59-8ec4-4fb1-9879-0e7d37e23ba8]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25, portal: 172.16.0.220,3260]
Aug 27 04:12:28 user nova-compute[72990]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25, portal: 172.16.0.220,3260] successful.
Aug 27 04:12:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7ec106-48e7-483d-9504-4944bf99ba25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[db801e36-cb88-4878-8246-6b179bfaab50]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] <== disconnect_volume: return (302ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:12:28 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Took 1.42 seconds to deallocate network for instance.
Aug 27 04:12:28 user nova-compute[72990]: WARNING nova.volume.cinder [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Attachment 44092884-37a5-44fc-a763-f01f34b50903 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 44092884-37a5-44fc-a763-f01f34b50903. (HTTP 404) (Request-ID: req-b5b99290-3a6c-4938-8818-8d9ba66d465c)
Aug 27 04:12:28 user nova-compute[72990]: INFO nova.compute.manager [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Took 0.02 seconds to detach 1 volumes for instance.
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-4eb4e156-f17a-4b5b-84d5-e953412e2905 req-049d11ae-326d-427d-af77-017a53c4f86e service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Received event network-vif-plugged-0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4eb4e156-f17a-4b5b-84d5-e953412e2905 req-049d11ae-326d-427d-af77-017a53c4f86e service nova] Acquiring lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4eb4e156-f17a-4b5b-84d5-e953412e2905 req-049d11ae-326d-427d-af77-017a53c4f86e service nova] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4eb4e156-f17a-4b5b-84d5-e953412e2905 req-049d11ae-326d-427d-af77-017a53c4f86e service nova] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-4eb4e156-f17a-4b5b-84d5-e953412e2905 req-049d11ae-326d-427d-af77-017a53c4f86e service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] No waiting events found dispatching network-vif-plugged-0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:12:28 user nova-compute[72990]: WARNING nova.compute.manager [req-4eb4e156-f17a-4b5b-84d5-e953412e2905 req-049d11ae-326d-427d-af77-017a53c4f86e service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Received unexpected event network-vif-plugged-0498f2e1-b488-4c8b-90f6-51343e41b0df for instance with vm_state deleted and task_state None.
Aug 27 04:12:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-4eb4e156-f17a-4b5b-84d5-e953412e2905 req-049d11ae-326d-427d-af77-017a53c4f86e service nova] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Received event network-vif-deleted-0498f2e1-b488-4c8b-90f6-51343e41b0df {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-4483de31-c0dc-41cd-8aa6-99eccad1f2b8 req-abe88166-2f2c-4f3d-95d9-eb092465b914 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-changed-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-4483de31-c0dc-41cd-8aa6-99eccad1f2b8 req-abe88166-2f2c-4f3d-95d9-eb092465b914 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Refreshing instance network info cache due to event network-changed-04dc6ccc-6386-4870-86a2-2cfd0973ec3a. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4483de31-c0dc-41cd-8aa6-99eccad1f2b8 req-abe88166-2f2c-4f3d-95d9-eb092465b914 service nova] Acquiring lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4483de31-c0dc-41cd-8aa6-99eccad1f2b8 req-abe88166-2f2c-4f3d-95d9-eb092465b914 service nova] Acquired lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG nova.network.neutron [req-4483de31-c0dc-41cd-8aa6-99eccad1f2b8 req-abe88166-2f2c-4f3d-95d9-eb092465b914 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Refreshing network info cache for port 04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:12:28 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:12:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:29 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Deleted allocations for instance fbba3f29-4b57-43c8-aecd-27e8d3d85c44
Aug 27 04:12:29 user nova-compute[72990]: DEBUG nova.objects.instance [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lazy-loading 'flavor' on Instance uuid b0392f8e-364d-450b-84c7-7b3f631a3a58 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:12:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-608a67aa-b539-4f9d-907c-985d3ffc63d5 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.924s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b765ea52-4f79-4292-aca5-7b558e37f667 tempest-VolumesSnapshotTestJSON-1409906536 tempest-VolumesSnapshotTestJSON-1409906536-project-member] Lock "fbba3f29-4b57-43c8-aecd-27e8d3d85c44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.169s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:29 user nova-compute[72990]: DEBUG nova.network.neutron [req-4483de31-c0dc-41cd-8aa6-99eccad1f2b8 req-abe88166-2f2c-4f3d-95d9-eb092465b914 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updated VIF entry in instance network info cache for port 04dc6ccc-6386-4870-86a2-2cfd0973ec3a. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:12:29 user nova-compute[72990]: DEBUG nova.network.neutron [req-4483de31-c0dc-41cd-8aa6-99eccad1f2b8 req-abe88166-2f2c-4f3d-95d9-eb092465b914 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updating instance_info_cache with network_info: [{"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:12:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-4483de31-c0dc-41cd-8aa6-99eccad1f2b8 req-abe88166-2f2c-4f3d-95d9-eb092465b914 service nova] Releasing lock "refresh_cache-b0392f8e-364d-450b-84c7-7b3f631a3a58" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:12:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:41 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109546.951777, fbba3f29-4b57-43c8-aecd-27e8d3d85c44 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:12:41 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] VM Stopped (Lifecycle Event)
Aug 27 04:12:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-8cabbd12-b8ad-41f0-ab18-bd85862f13c2 None None] [instance: fbba3f29-4b57-43c8-aecd-27e8d3d85c44] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:12:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:46 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:12:46 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:12:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:12:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:50 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:12:51 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:12:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:12:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:12:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:52 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:12:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:12:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:12:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:12:53 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:12:53 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:12:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8212MB free_disk=25.065555572509766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:12:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:12:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:12:54 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance b0392f8e-364d-450b-84c7-7b3f631a3a58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:12:54 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 7a8653d7-ffad-43fa-81b7-6fd04c67e98c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:12:54 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 49de835f-41fb-4ba5-97cc-bfc1867290b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:12:54 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:12:54 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:12:54 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:12:54 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:12:54 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:12:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:12:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:12:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:12:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Didn't find any instances for network info cache update. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 04:12:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:12:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:12:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:12:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:01 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:13:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:26 user nova-compute[72990]: INFO nova.compute.manager [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Terminating instance
Aug 27 04:13:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-38308833-bdf4-4f95-a946-eb1c4e0d7ad7 req-c122ed9a-87ae-4e05-8b6c-88ac5bdaabbf service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-vif-unplugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-38308833-bdf4-4f95-a946-eb1c4e0d7ad7 req-c122ed9a-87ae-4e05-8b6c-88ac5bdaabbf service nova] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-38308833-bdf4-4f95-a946-eb1c4e0d7ad7 req-c122ed9a-87ae-4e05-8b6c-88ac5bdaabbf service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-38308833-bdf4-4f95-a946-eb1c4e0d7ad7 req-c122ed9a-87ae-4e05-8b6c-88ac5bdaabbf service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-38308833-bdf4-4f95-a946-eb1c4e0d7ad7 req-c122ed9a-87ae-4e05-8b6c-88ac5bdaabbf service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] No waiting events found dispatching network-vif-unplugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:13:26 user nova-compute[72990]: DEBUG nova.compute.manager [req-38308833-bdf4-4f95-a946-eb1c4e0d7ad7 req-c122ed9a-87ae-4e05-8b6c-88ac5bdaabbf service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-vif-unplugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Instance destroyed successfully.
Aug 27 04:13:27 user nova-compute[72990]: DEBUG nova.objects.instance [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lazy-loading 'resources' on Instance uuid b0392f8e-364d-450b-84c7-7b3f631a3a58 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-113645242',display_name='tempest-TestMinimumBasicScenario-server-113645242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-113645242',id=44,image_ref='e974cd05-3280-4593-a8a7-bd5320760de9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMePMsKabLu6DdPJCYVZvdqJr7DT8Fg2ju1oAMSkNGRcx5z0JjFHObhmQEZFe+dZRe9b28saTqmVvP+52HKoi09AsSL7Ko60fyM8vs9KTOTQn+BfOScX2V2frLCIGTxgA==',key_name='tempest-TestMinimumBasicScenario-263442039',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:08:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b2eb083c82b4dfcbad70f865367a84a',ramdisk_id='',reservation_id='r-2xtbghow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e974cd05-3280-4593-a8a7-bd5320760de9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1213348251',owner_user_name='tempest-TestMinimumBasicScenario-1213348251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:10:41Z,user_data=None,user_id='8a2bca29600d4e3e8915894716b24bdc',uuid=b0392f8e-364d-450b-84c7-7b3f631a3a58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Converting VIF {"id": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "address": "fa:16:3e:f4:d3:f0", "network": {"id": "65f0aa81-845a-4b89-8040-d332b3a66ce5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1465968280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b2eb083c82b4dfcbad70f865367a84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc6ccc-63", "ovs_interfaceid": "04dc6ccc-6386-4870-86a2-2cfd0973ec3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d3:f0,bridge_name='br-int',has_traffic_filtering=True,id=04dc6ccc-6386-4870-86a2-2cfd0973ec3a,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc6ccc-63') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG os_vif [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d3:f0,bridge_name='br-int',has_traffic_filtering=True,id=04dc6ccc-6386-4870-86a2-2cfd0973ec3a,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc6ccc-63') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04dc6ccc-63, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:13:27 user nova-compute[72990]: INFO os_vif [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d3:f0,bridge_name='br-int',has_traffic_filtering=True,id=04dc6ccc-6386-4870-86a2-2cfd0973ec3a,network=Network(65f0aa81-845a-4b89-8040-d332b3a66ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc6ccc-63')
Aug 27 04:13:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Deleting instance files /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58_del
Aug 27 04:13:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Deletion of /opt/stack/data/nova/instances/b0392f8e-364d-450b-84c7-7b3f631a3a58_del complete
Aug 27 04:13:27 user nova-compute[72990]: INFO nova.compute.manager [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 27 04:13:27 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:13:27 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Took 0.54 seconds to deallocate network for instance.
Aug 27 04:13:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:28 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:13:28 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:13:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:28 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Deleted allocations for instance b0392f8e-364d-450b-84c7-7b3f631a3a58
Aug 27 04:13:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-efd02e2e-50fe-47a9-a9c9-8333b24decb0 tempest-TestMinimumBasicScenario-1213348251 tempest-TestMinimumBasicScenario-1213348251-project-member] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.914s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-626912db-e258-43f5-b828-525bb244a72a req-9e55d303-c6da-4ef9-b59e-0fe4967ccce4 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:13:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-626912db-e258-43f5-b828-525bb244a72a req-9e55d303-c6da-4ef9-b59e-0fe4967ccce4 service nova] Acquiring lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-626912db-e258-43f5-b828-525bb244a72a req-9e55d303-c6da-4ef9-b59e-0fe4967ccce4 service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:28 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-626912db-e258-43f5-b828-525bb244a72a req-9e55d303-c6da-4ef9-b59e-0fe4967ccce4 service nova] Lock "b0392f8e-364d-450b-84c7-7b3f631a3a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-626912db-e258-43f5-b828-525bb244a72a req-9e55d303-c6da-4ef9-b59e-0fe4967ccce4 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] No waiting events found dispatching network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:13:28 user nova-compute[72990]: WARNING nova.compute.manager [req-626912db-e258-43f5-b828-525bb244a72a req-9e55d303-c6da-4ef9-b59e-0fe4967ccce4 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received unexpected event network-vif-plugged-04dc6ccc-6386-4870-86a2-2cfd0973ec3a for instance with vm_state deleted and task_state None.
Aug 27 04:13:28 user nova-compute[72990]: DEBUG nova.compute.manager [req-626912db-e258-43f5-b828-525bb244a72a req-9e55d303-c6da-4ef9-b59e-0fe4967ccce4 service nova] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Received event network-vif-deleted-04dc6ccc-6386-4870-86a2-2cfd0973ec3a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:13:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-577c71ad-909c-4a8c-a0aa-1c0d61a2f230 req-af27b95d-1047-4dc4-8ac1-6b06970a6aa6 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-changed-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:13:36 user nova-compute[72990]: DEBUG nova.compute.manager [req-577c71ad-909c-4a8c-a0aa-1c0d61a2f230 req-af27b95d-1047-4dc4-8ac1-6b06970a6aa6 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Refreshing instance network info cache due to event network-changed-eee320f3-ed97-4edf-a3c7-91341f5c296a. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:13:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-577c71ad-909c-4a8c-a0aa-1c0d61a2f230 req-af27b95d-1047-4dc4-8ac1-6b06970a6aa6 service nova] Acquiring lock "refresh_cache-7a8653d7-ffad-43fa-81b7-6fd04c67e98c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:13:36 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-577c71ad-909c-4a8c-a0aa-1c0d61a2f230 req-af27b95d-1047-4dc4-8ac1-6b06970a6aa6 service nova] Acquired lock "refresh_cache-7a8653d7-ffad-43fa-81b7-6fd04c67e98c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:13:36 user nova-compute[72990]: DEBUG nova.network.neutron [req-577c71ad-909c-4a8c-a0aa-1c0d61a2f230 req-af27b95d-1047-4dc4-8ac1-6b06970a6aa6 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Refreshing network info cache for port eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:13:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:13:37 user nova-compute[72990]: DEBUG nova.network.neutron [req-577c71ad-909c-4a8c-a0aa-1c0d61a2f230 req-af27b95d-1047-4dc4-8ac1-6b06970a6aa6 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Updated VIF entry in instance network info cache for port eee320f3-ed97-4edf-a3c7-91341f5c296a. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:13:37 user nova-compute[72990]: DEBUG nova.network.neutron [req-577c71ad-909c-4a8c-a0aa-1c0d61a2f230 req-af27b95d-1047-4dc4-8ac1-6b06970a6aa6 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Updating instance_info_cache with network_info: [{"id": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "address": "fa:16:3e:17:1e:c0", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee320f3-ed", "ovs_interfaceid": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:13:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-577c71ad-909c-4a8c-a0aa-1c0d61a2f230 req-af27b95d-1047-4dc4-8ac1-6b06970a6aa6 service nova] Releasing lock "refresh_cache-7a8653d7-ffad-43fa-81b7-6fd04c67e98c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:38 user nova-compute[72990]: INFO nova.compute.manager [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Terminating instance
Aug 27 04:13:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG nova.compute.manager [req-5b990b32-7836-4176-a49b-276416c5b8e1 req-1c518a04-865b-4ea7-ae1f-42de9d2ca4dc service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-vif-unplugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5b990b32-7836-4176-a49b-276416c5b8e1 req-1c518a04-865b-4ea7-ae1f-42de9d2ca4dc service nova] Acquiring lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5b990b32-7836-4176-a49b-276416c5b8e1 req-1c518a04-865b-4ea7-ae1f-42de9d2ca4dc service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-5b990b32-7836-4176-a49b-276416c5b8e1 req-1c518a04-865b-4ea7-ae1f-42de9d2ca4dc service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG nova.compute.manager [req-5b990b32-7836-4176-a49b-276416c5b8e1 req-1c518a04-865b-4ea7-ae1f-42de9d2ca4dc service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] No waiting events found dispatching network-vif-unplugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:13:38 user nova-compute[72990]: DEBUG nova.compute.manager [req-5b990b32-7836-4176-a49b-276416c5b8e1 req-1c518a04-865b-4ea7-ae1f-42de9d2ca4dc service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-vif-unplugged-eee320f3-ed97-4edf-a3c7-91341f5c296a for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:39 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Instance destroyed successfully.
Aug 27 04:13:39 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lazy-loading 'resources' on Instance uuid 7a8653d7-ffad-43fa-81b7-6fd04c67e98c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-419855681',display_name='tempest-TestVolumeBootPattern-server-419855681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-419855681',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAxiq8nzDuLrhlX90KCpMhjjdu00EEsfsUBjmDNf2QVNBgoIetJr5kJSGJfbGHc1lKfJ77a4En5IQ+5dvysFKDT9aLp7EGC0j0/Z1Ri5VH2ji/z9XR9yuImUkcGl95llA==',key_name='tempest-TestVolumeBootPattern-1921423690',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-iyzrp7wb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:12:22Z,user_data=None,user_id='cf3112e616344af7873a50d134260637',uuid=7a8653d7-ffad-43fa-81b7-6fd04c67e98c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "address": "fa:16:3e:17:1e:c0", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee320f3-ed", "ovs_interfaceid": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "address": "fa:16:3e:17:1e:c0", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee320f3-ed", "ovs_interfaceid": "eee320f3-ed97-4edf-a3c7-91341f5c296a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:1e:c0,bridge_name='br-int',has_traffic_filtering=True,id=eee320f3-ed97-4edf-a3c7-91341f5c296a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeee320f3-ed') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_vif [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:1e:c0,bridge_name='br-int',has_traffic_filtering=True,id=eee320f3-ed97-4edf-a3c7-91341f5c296a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeee320f3-ed') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeee320f3-ed, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:13:39 user nova-compute[72990]: INFO os_vif [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:1e:c0,bridge_name='br-int',has_traffic_filtering=True,id=eee320f3-ed97-4edf-a3c7-91341f5c296a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeee320f3-ed')
Aug 27 04:13:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhJcfbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:13:39 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b883a57-df27-4311-acab-c68d143b7cc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fb9553-97e8-48a0-b12a-96bf746532d8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:13:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:13:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f43d1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b878ebfa-0694-4dba-aaa2-ecff6c8b7deb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[76003455-a5f8-47a3-b839-c0dd769034dd]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca33061-72fc-4c29-868d-7cbaca372f30]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2480462-3d7d-4ef8-9410-3107fd2a2658]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb319ea-17c1-4f6a-84bc-efbeaae0286d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee84641a-7512-4f00-aa32-40b8ecd74a0e]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260]
Aug 27 04:13:39 user nova-compute[72990]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260] successful.
Aug 27 04:13:39 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[781cd8da-705b-4db1-b90c-109771ab22ee]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== disconnect_volume: return (311ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:13:39 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Deleting instance files /opt/stack/data/nova/instances/7a8653d7-ffad-43fa-81b7-6fd04c67e98c_del
Aug 27 04:13:39 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Deletion of /opt/stack/data/nova/instances/7a8653d7-ffad-43fa-81b7-6fd04c67e98c_del complete
Aug 27 04:13:39 user nova-compute[72990]: INFO nova.compute.manager [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 27 04:13:39 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Acquiring lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] No waiting events found dispatching network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:13:40 user nova-compute[72990]: WARNING nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received unexpected event network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a for instance with vm_state active and task_state deleting.
Aug 27 04:13:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Acquiring lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] No waiting events found dispatching network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:13:40 user nova-compute[72990]: WARNING nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received unexpected event network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a for instance with vm_state active and task_state deleting.
Aug 27 04:13:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Acquiring lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] No waiting events found dispatching network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:13:40 user nova-compute[72990]: WARNING nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received unexpected event network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a for instance with vm_state active and task_state deleting.
Aug 27 04:13:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-vif-unplugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Acquiring lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] No waiting events found dispatching network-vif-unplugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-vif-unplugged-eee320f3-ed97-4edf-a3c7-91341f5c296a for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Acquiring lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:40 user nova-compute[72990]: DEBUG nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] No waiting events found dispatching network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:13:40 user nova-compute[72990]: WARNING nova.compute.manager [req-c8b5bbd5-bb64-482c-b09f-5349d4bc1834 req-e3dea85a-eb67-4cda-aa89-267410ddb572 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received unexpected event network-vif-plugged-eee320f3-ed97-4edf-a3c7-91341f5c296a for instance with vm_state active and task_state deleting.
Aug 27 04:13:41 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:13:41 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Took 1.75 seconds to deallocate network for instance.
Aug 27 04:13:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-3d7f7cdd-0d38-45e7-9f52-6d2ace0f77fa req-648ed63f-49ad-4976-be7b-b5f53f4c9921 service nova] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Received event network-vif-deleted-eee320f3-ed97-4edf-a3c7-91341f5c296a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:13:42 user nova-compute[72990]: INFO nova.compute.manager [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Took 0.81 seconds to detach 1 volumes for instance.
Aug 27 04:13:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:42 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109607.190505, b0392f8e-364d-450b-84c7-7b3f631a3a58 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:13:42 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] VM Stopped (Lifecycle Event)
Aug 27 04:13:42 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:13:42 user nova-compute[72990]: DEBUG nova.compute.manager [None req-befe5a43-00a9-4c6b-a208-dddbfc2dcad2 None None] [instance: b0392f8e-364d-450b-84c7-7b3f631a3a58] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:13:42 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:13:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:42 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Deleted allocations for instance 7a8653d7-ffad-43fa-81b7-6fd04c67e98c
Aug 27 04:13:42 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2a1069cb-db6d-4dc6-be20-3f8efc61d685 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "7a8653d7-ffad-43fa-81b7-6fd04c67e98c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.148s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:46 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:13:46 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:13:48 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:13:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:13:51 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:13:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:13:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:13:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:52 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:52 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:13:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:13:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:13:52 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:13:53 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:13:53 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:13:53 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:13:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8563MB free_disk=25.089839935302734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:13:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:13:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:13:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 49de835f-41fb-4ba5-97cc-bfc1867290b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:13:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:13:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:13:53 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:13:53 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:13:53 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:13:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:13:54 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109619.066407, 7a8653d7-ffad-43fa-81b7-6fd04c67e98c => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:13:54 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] VM Stopped (Lifecycle Event)
Aug 27 04:13:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-29d448e7-a626-4b61-a3c5-251e35e9c0d2 None None] [instance: 7a8653d7-ffad-43fa-81b7-6fd04c67e98c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:13:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:13:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:13:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:13:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:13:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-49de835f-41fb-4ba5-97cc-bfc1867290b0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:13:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-49de835f-41fb-4ba5-97cc-bfc1867290b0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:13:55 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:13:55 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid 49de835f-41fb-4ba5-97cc-bfc1867290b0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:13:56 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Updating instance_info_cache with network_info: [{"id": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "address": "fa:16:3e:f5:a9:04", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb43d81f2-cb", "ovs_interfaceid": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:13:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-49de835f-41fb-4ba5-97cc-bfc1867290b0" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:13:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:13:56 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:13:56 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:13:56 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:13:59 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "49de835f-41fb-4ba5-97cc-bfc1867290b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:14:11 user nova-compute[72990]: INFO nova.compute.manager [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Terminating instance
Aug 27 04:14:11 user nova-compute[72990]: DEBUG nova.compute.manager [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-8e9131f5-d613-4b30-928b-21764598815e req-e9e83efc-abd1-4585-819a-ab4804342bfa service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Received event network-vif-unplugged-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8e9131f5-d613-4b30-928b-21764598815e req-e9e83efc-abd1-4585-819a-ab4804342bfa service nova] Acquiring lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8e9131f5-d613-4b30-928b-21764598815e req-e9e83efc-abd1-4585-819a-ab4804342bfa service nova] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-8e9131f5-d613-4b30-928b-21764598815e req-e9e83efc-abd1-4585-819a-ab4804342bfa service nova] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-8e9131f5-d613-4b30-928b-21764598815e req-e9e83efc-abd1-4585-819a-ab4804342bfa service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] No waiting events found dispatching network-vif-unplugged-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-8e9131f5-d613-4b30-928b-21764598815e req-e9e83efc-abd1-4585-819a-ab4804342bfa service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Received event network-vif-unplugged-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:14:11 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Instance destroyed successfully.
Aug 27 04:14:11 user nova-compute[72990]: DEBUG nova.objects.instance [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lazy-loading 'resources' on Instance uuid 49de835f-41fb-4ba5-97cc-bfc1867290b0 {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1067143970',display_name='tempest-VolumesActionsTest-instance-1067143970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1067143970',id=49,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:12:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='161e68b849ab44c1bd68f134d620add6',ramdisk_id='',reservation_id='r-zle32wpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1193624458',owner_user_name='tempest-VolumesActionsTest-1193624458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:12:27Z,user_data=None,user_id='12f4f79d69a147568e4e0a44ffbf6591',uuid=49de835f-41fb-4ba5-97cc-bfc1867290b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "address": "fa:16:3e:f5:a9:04", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb43d81f2-cb", "ovs_interfaceid": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Converting VIF {"id": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "address": "fa:16:3e:f5:a9:04", "network": {"id": "a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301914980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "161e68b849ab44c1bd68f134d620add6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb43d81f2-cb", "ovs_interfaceid": "b43d81f2-cbd2-448f-b2b3-59d31ae294b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:a9:04,bridge_name='br-int',has_traffic_filtering=True,id=b43d81f2-cbd2-448f-b2b3-59d31ae294b3,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb43d81f2-cb') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG os_vif [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:a9:04,bridge_name='br-int',has_traffic_filtering=True,id=b43d81f2-cbd2-448f-b2b3-59d31ae294b3,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb43d81f2-cb') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb43d81f2-cb, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:14:11 user nova-compute[72990]: INFO os_vif [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:a9:04,bridge_name='br-int',has_traffic_filtering=True,id=b43d81f2-cbd2-448f-b2b3-59d31ae294b3,network=Network(a0fb28b1-e2c6-4a35-a0b6-f810e50d1baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb43d81f2-cb')
Aug 27 04:14:11 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Deleting instance files /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0_del
Aug 27 04:14:11 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Deletion of /opt/stack/data/nova/instances/49de835f-41fb-4ba5-97cc-bfc1867290b0_del complete
Aug 27 04:14:11 user nova-compute[72990]: INFO nova.compute.manager [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 27 04:14:11 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:14:11 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:14:12 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:14:12 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Took 0.60 seconds to deallocate network for instance.
Aug 27 04:14:12 user nova-compute[72990]: DEBUG nova.compute.manager [req-4dfa5ecf-7980-4975-8040-490758848154 req-8779c31b-c7e2-47a7-8aba-9ed9fad8221a service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Received event network-vif-deleted-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:14:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:14:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:14:12 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:14:12 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:14:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:14:12 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Deleted allocations for instance 49de835f-41fb-4ba5-97cc-bfc1867290b0
Aug 27 04:14:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-3836cc6f-bc22-404e-a31f-96a9ff89c45b tempest-VolumesActionsTest-1193624458 tempest-VolumesActionsTest-1193624458-project-member] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.757s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:14:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-de4313eb-8814-48b8-bef5-e1fe80647a24 req-661554fa-4b04-4981-8d66-5a24b682d5fd service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Received event network-vif-plugged-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:14:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-de4313eb-8814-48b8-bef5-e1fe80647a24 req-661554fa-4b04-4981-8d66-5a24b682d5fd service nova] Acquiring lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:14:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-de4313eb-8814-48b8-bef5-e1fe80647a24 req-661554fa-4b04-4981-8d66-5a24b682d5fd service nova] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:14:13 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-de4313eb-8814-48b8-bef5-e1fe80647a24 req-661554fa-4b04-4981-8d66-5a24b682d5fd service nova] Lock "49de835f-41fb-4ba5-97cc-bfc1867290b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:14:13 user nova-compute[72990]: DEBUG nova.compute.manager [req-de4313eb-8814-48b8-bef5-e1fe80647a24 req-661554fa-4b04-4981-8d66-5a24b682d5fd service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] No waiting events found dispatching network-vif-plugged-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:14:13 user nova-compute[72990]: WARNING nova.compute.manager [req-de4313eb-8814-48b8-bef5-e1fe80647a24 req-661554fa-4b04-4981-8d66-5a24b682d5fd service nova] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Received unexpected event network-vif-plugged-b43d81f2-cbd2-448f-b2b3-59d31ae294b3 for instance with vm_state deleted and task_state None.
Aug 27 04:14:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:26 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109651.835132, 49de835f-41fb-4ba5-97cc-bfc1867290b0 => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:14:26 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] VM Stopped (Lifecycle Event)
Aug 27 04:14:26 user nova-compute[72990]: DEBUG nova.compute.manager [None req-00b3e610-c9e7-4240-8713-674f8879e9b8 None None] [instance: 49de835f-41fb-4ba5-97cc-bfc1867290b0] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:14:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:14:30 user nova-compute[72990]: INFO nova.compute.claims [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Claim successful on node user
Aug 27 04:14:30 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.187s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG nova.network.neutron [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:14:30 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:14:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:14:30 user nova-compute[72990]: INFO nova.virt.block_device [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Booting with volume 23922e53-afbc-46e7-bf42-af1a78569fbd at /dev/vda
Aug 27 04:14:30 user nova-compute[72990]: DEBUG nova.policy [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf3112e616344af7873a50d134260637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6b19a372f947e4aee43f9d7573e8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG os_brick.utils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[044b1154-34a2-4861-83da-cdf8a62a9261]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[011a37eb-c269-4df1-9d94-ba7277b35bcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7027ff-455b-4d38-aa43-98f0f15cf0c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98e10ce-8bf6-4d90-ab3c-286e340fb34b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:14:30 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:14:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd0df0-30a6-40ec-be4a-2fdda7a3bc2b]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG os_brick.utils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:14:30 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updating existing volume attachment record: a3691aa6-f219-43c7-a3f7-cddb4042e0a1 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:14:31 user nova-compute[72990]: DEBUG nova.network.neutron [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Successfully created port: 77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:14:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:14:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:14:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:14:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:14:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Successfully updated port: 77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquired lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-50e6bdf5-1f2d-42cc-b53b-5197d84cc441 req-65f3857e-7fe9-425f-a086-900fd0303204 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Received event network-changed-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-50e6bdf5-1f2d-42cc-b53b-5197d84cc441 req-65f3857e-7fe9-425f-a086-900fd0303204 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Refreshing instance network info cache due to event network-changed-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-50e6bdf5-1f2d-42cc-b53b-5197d84cc441 req-65f3857e-7fe9-425f-a086-900fd0303204 service nova] Acquiring lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG nova.network.neutron [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updating instance_info_cache with network_info: [{"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Releasing lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Instance network_info: |[{"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-50e6bdf5-1f2d-42cc-b53b-5197d84cc441 req-65f3857e-7fe9-425f-a086-900fd0303204 service nova] Acquired lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:14:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-50e6bdf5-1f2d-42cc-b53b-5197d84cc441 req-65f3857e-7fe9-425f-a086-900fd0303204 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Refreshing network info cache for port 77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:14:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-50e6bdf5-1f2d-42cc-b53b-5197d84cc441 req-65f3857e-7fe9-425f-a086-900fd0303204 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updated VIF entry in instance network info cache for port 77e9607a-ea35-4a9e-8d62-9cb9ae9ee296. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:14:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-50e6bdf5-1f2d-42cc-b53b-5197d84cc441 req-65f3857e-7fe9-425f-a086-900fd0303204 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updating instance_info_cache with network_info: [{"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:14:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-50e6bdf5-1f2d-42cc-b53b-5197d84cc441 req-65f3857e-7fe9-425f-a086-900fd0303204 service nova] Releasing lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:14:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:14:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:48 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:14:48 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:14:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.compute.manager [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:14:51 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Creating image(s)
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Ensure instance console log exists: /opt/stack/data/nova/instances/c891ea66-5861-4d50-b4e1-0c20ae481fdc/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Start _get_guest_xml network_info=[{"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'a3691aa6-f219-43c7-a3f7-cddb4042e0a1', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhJcfbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c891ea66-5861-4d50-b4e1-0c20ae481fdc', 'attached_at': '', 'detached_at': '', 'volume_id': '23922e53-afbc-46e7-bf42-af1a78569fbd', 'serial': '23922e53-afbc-46e7-bf42-af1a78569fbd'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:14:51 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:14:51 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhJcfbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:14:51 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:14:51 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:14:51 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c1da10-cac3-4392-89e5-ecf8e554d5bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:14:51 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9cadda-8400-44ef-8838-b68a4f05d7d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd] added
Aug 27 04:14:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17a7ba4-f475-40a1-a3c4-1eb57efef73b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1841af1-179a-4c99-af0b-56ebfd8952c8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDhJcfbs {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDhJcfbs" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e144562-fccc-4cb4-97e7-4b9bc2ae4563]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BDhJcfbs'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b11e1e1-1ddf-424e-8e8d-ae2cec289651]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1318bd3a-df21-4d3d-82c9-b32e9b8b978e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6627651-e921-48aa-ae51-0b492a1ece00 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6627651-e921-48aa-ae51-0b492a1ece00 (non-flash)
Aug 27 04:14:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6627651-e921-48aa-ae51-0b492a1ece00 (non-flash)
Aug 27 04:14:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed929146-3320-4669-b0d6-af2f01cd4a59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260]
Aug 27 04:14:51 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260] successful.
Aug 27 04:14:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f0f390-cff4-4037-b5c7-c1d900849516]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9715573a-cdb0-47f3-9f58-5d51b9d73162]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6627651-e921-48aa-ae51-0b492a1ece00 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6627651-e921-48aa-ae51-0b492a1ece00 (non-flash)
Aug 27 04:14:51 user nova-compute[72990]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:14:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6627651-e921-48aa-ae51-0b492a1ece00 (non-flash)
Aug 27 04:14:51 user nova-compute[72990]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:14:51 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a997032-8544-44dc-a804-02c13b8ae308]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:14:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhJcfbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23761623534346337', 'path': '/dev/sdc'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761623534346337', 'path': '/dev/sdc'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:14:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1856381000',display_name='tempest-TestVolumeBootPattern-server-1856381000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1856381000',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAxiq8nzDuLrhlX90KCpMhjjdu00EEsfsUBjmDNf2QVNBgoIetJr5kJSGJfbGHc1lKfJ77a4En5IQ+5dvysFKDT9aLp7EGC0j0/Z1Ri5VH2ji/z9XR9yuImUkcGl95llA==',key_name='tempest-TestVolumeBootPattern-1921423690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-d19rghq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:14:31Z,user_data=None,user_id='cf3112e616344af7873a50d134260637',uuid=c891ea66-5861-4d50-b4e1-0c20ae481fdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ae:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e9607a-ea35-4a9e-8d62-9cb9ae9ee296,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e9607a-ea') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG nova.objects.instance [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lazy-loading 'pci_devices' on Instance uuid c891ea66-5861-4d50-b4e1-0c20ae481fdc {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:14:52 user nova-compute[72990]:   <uuid>c891ea66-5861-4d50-b4e1-0c20ae481fdc</uuid>
Aug 27 04:14:52 user nova-compute[72990]:   <name>instance-00000032</name>
Aug 27 04:14:52 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:14:52 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:14:52 user nova-compute[72990]:   <metadata>
Aug 27 04:14:52 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:14:52 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:14:52 user nova-compute[72990]:       <nova:name>tempest-TestVolumeBootPattern-server-1856381000</nova:name>
Aug 27 04:14:52 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:14:51</nova:creationTime>
Aug 27 04:14:52 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:14:52 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:14:52 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:14:52 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:14:52 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:14:52 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:14:52 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:14:52 user nova-compute[72990]:       <nova:owner>
Aug 27 04:14:52 user nova-compute[72990]:         <nova:user uuid="cf3112e616344af7873a50d134260637">tempest-TestVolumeBootPattern-1834919775-project-member</nova:user>
Aug 27 04:14:52 user nova-compute[72990]:         <nova:project uuid="6d6b19a372f947e4aee43f9d7573e8f7">tempest-TestVolumeBootPattern-1834919775</nova:project>
Aug 27 04:14:52 user nova-compute[72990]:       </nova:owner>
Aug 27 04:14:52 user nova-compute[72990]:       <nova:ports>
Aug 27 04:14:52 user nova-compute[72990]:         <nova:port uuid="77e9607a-ea35-4a9e-8d62-9cb9ae9ee296">
Aug 27 04:14:52 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 04:14:52 user nova-compute[72990]:         </nova:port>
Aug 27 04:14:52 user nova-compute[72990]:       </nova:ports>
Aug 27 04:14:52 user nova-compute[72990]:     </nova:instance>
Aug 27 04:14:52 user nova-compute[72990]:   </metadata>
Aug 27 04:14:52 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:14:52 user nova-compute[72990]:     <system>
Aug 27 04:14:52 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:14:52 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:14:52 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:14:52 user nova-compute[72990]:       <entry name="serial">c891ea66-5861-4d50-b4e1-0c20ae481fdc</entry>
Aug 27 04:14:52 user nova-compute[72990]:       <entry name="uuid">c891ea66-5861-4d50-b4e1-0c20ae481fdc</entry>
Aug 27 04:14:52 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:14:52 user nova-compute[72990]:     </system>
Aug 27 04:14:52 user nova-compute[72990]:   </sysinfo>
Aug 27 04:14:52 user nova-compute[72990]:   <os>
Aug 27 04:14:52 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:14:52 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:14:52 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:14:52 user nova-compute[72990]:   </os>
Aug 27 04:14:52 user nova-compute[72990]:   <features>
Aug 27 04:14:52 user nova-compute[72990]:     <acpi/>
Aug 27 04:14:52 user nova-compute[72990]:     <apic/>
Aug 27 04:14:52 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:14:52 user nova-compute[72990]:   </features>
Aug 27 04:14:52 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:14:52 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:14:52 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:14:52 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:14:52 user nova-compute[72990]:   </clock>
Aug 27 04:14:52 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:14:52 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:14:52 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:14:52 user nova-compute[72990]:   </cpu>
Aug 27 04:14:52 user nova-compute[72990]:   <devices>
Aug 27 04:14:52 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 04:14:52 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:14:52 user nova-compute[72990]:       <source dev="/dev/sdc"/>
Aug 27 04:14:52 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:14:52 user nova-compute[72990]:       <serial>23922e53-afbc-46e7-bf42-af1a78569fbd</serial>
Aug 27 04:14:52 user nova-compute[72990]:     </disk>
Aug 27 04:14:52 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:14:52 user nova-compute[72990]:       <mac address="fa:16:3e:16:ae:aa"/>
Aug 27 04:14:52 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:14:52 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:14:52 user nova-compute[72990]:       <target dev="tap77e9607a-ea"/>
Aug 27 04:14:52 user nova-compute[72990]:     </interface>
Aug 27 04:14:52 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:14:52 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/c891ea66-5861-4d50-b4e1-0c20ae481fdc/console.log" append="off"/>
Aug 27 04:14:52 user nova-compute[72990]:     </serial>
Aug 27 04:14:52 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:14:52 user nova-compute[72990]:     <video>
Aug 27 04:14:52 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:14:52 user nova-compute[72990]:     </video>
Aug 27 04:14:52 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:14:52 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:14:52 user nova-compute[72990]:     </rng>
Aug 27 04:14:52 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:14:52 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:14:52 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:14:52 user nova-compute[72990]:     </memballoon>
Aug 27 04:14:52 user nova-compute[72990]:   </devices>
Aug 27 04:14:52 user nova-compute[72990]: </domain>
Aug 27 04:14:52 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:14:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1856381000',display_name='tempest-TestVolumeBootPattern-server-1856381000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1856381000',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAxiq8nzDuLrhlX90KCpMhjjdu00EEsfsUBjmDNf2QVNBgoIetJr5kJSGJfbGHc1lKfJ77a4En5IQ+5dvysFKDT9aLp7EGC0j0/Z1Ri5VH2ji/z9XR9yuImUkcGl95llA==',key_name='tempest-TestVolumeBootPattern-1921423690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-d19rghq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:14:31Z,user_data=None,user_id='cf3112e616344af7873a50d134260637',uuid=c891ea66-5861-4d50-b4e1-0c20ae481fdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ae:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e9607a-ea35-4a9e-8d62-9cb9ae9ee296,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e9607a-ea') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG os_vif [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ae:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e9607a-ea35-4a9e-8d62-9cb9ae9ee296,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e9607a-ea') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77e9607a-ea, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77e9607a-ea, col_values=(('external_ids', {'iface-id': '77e9607a-ea35-4a9e-8d62-9cb9ae9ee296', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:ae:aa', 'vm-uuid': 'c891ea66-5861-4d50-b4e1-0c20ae481fdc'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:52 user nova-compute[72990]: INFO os_vif [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ae:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e9607a-ea35-4a9e-8d62-9cb9ae9ee296,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e9607a-ea')
Aug 27 04:14:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:14:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] No VIF found with MAC fa:16:3e:16:ae:aa, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:14:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-326d6708-5389-4c15-9168-63e15f8af771 req-ccc242fd-aaee-4065-a234-d59f3fa82905 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Received event network-vif-plugged-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-326d6708-5389-4c15-9168-63e15f8af771 req-ccc242fd-aaee-4065-a234-d59f3fa82905 service nova] Acquiring lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-326d6708-5389-4c15-9168-63e15f8af771 req-ccc242fd-aaee-4065-a234-d59f3fa82905 service nova] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-326d6708-5389-4c15-9168-63e15f8af771 req-ccc242fd-aaee-4065-a234-d59f3fa82905 service nova] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG nova.compute.manager [req-326d6708-5389-4c15-9168-63e15f8af771 req-ccc242fd-aaee-4065-a234-d59f3fa82905 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] No waiting events found dispatching network-vif-plugged-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:14:54 user nova-compute[72990]: WARNING nova.compute.manager [req-326d6708-5389-4c15-9168-63e15f8af771 req-ccc242fd-aaee-4065-a234-d59f3fa82905 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Received unexpected event network-vif-plugged-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 for instance with vm_state building and task_state spawning.
Aug 27 04:14:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:14:54 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:14:55 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:14:55 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:14:55 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8718MB free_disk=25.145801544189453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:14:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:14:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:14:55 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance c891ea66-5861-4d50-b4e1-0c20ae481fdc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:14:55 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:14:55 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:14:55 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:14:55 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:14:55 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:14:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109696.1836052, c891ea66-5861-4d50-b4e1-0c20ae481fdc => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:14:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] VM Resumed (Lifecycle Event)
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:14:56 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Instance spawned successfully.
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:14:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109696.18581, c891ea66-5861-4d50-b4e1-0c20ae481fdc => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:14:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] VM Started (Lifecycle Event)
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:14:56 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:14:56 user nova-compute[72990]: INFO nova.compute.manager [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:14:56 user nova-compute[72990]: INFO nova.compute.manager [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Took 26.11 seconds to build instance.
Aug 27 04:14:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-788b19d3-2029-44fd-9c57-697256562ecf tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.222s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-bf8332b4-041c-42e8-8be6-935866b7a714 req-93444a41-76b2-45d9-8af6-6628247cd62e service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Received event network-vif-plugged-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bf8332b4-041c-42e8-8be6-935866b7a714 req-93444a41-76b2-45d9-8af6-6628247cd62e service nova] Acquiring lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bf8332b4-041c-42e8-8be6-935866b7a714 req-93444a41-76b2-45d9-8af6-6628247cd62e service nova] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-bf8332b4-041c-42e8-8be6-935866b7a714 req-93444a41-76b2-45d9-8af6-6628247cd62e service nova] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:14:56 user nova-compute[72990]: DEBUG nova.compute.manager [req-bf8332b4-041c-42e8-8be6-935866b7a714 req-93444a41-76b2-45d9-8af6-6628247cd62e service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] No waiting events found dispatching network-vif-plugged-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:14:56 user nova-compute[72990]: WARNING nova.compute.manager [req-bf8332b4-041c-42e8-8be6-935866b7a714 req-93444a41-76b2-45d9-8af6-6628247cd62e service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Received unexpected event network-vif-plugged-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 for instance with vm_state active and task_state None.
Aug 27 04:14:57 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:14:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:14:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:14:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:14:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:14:57 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:14:57 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid c891ea66-5861-4d50-b4e1-0c20ae481fdc {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:14:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:14:58 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updating instance_info_cache with network_info: [{"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:14:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:14:58 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:14:58 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:15:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:15:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:15:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:15:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:15:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:15:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:27 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:15:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:15:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:15:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:15:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:47 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:15:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:49 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:15:50 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:15:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:15:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:15:52 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:15:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:15:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:15:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:15:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:15:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:15:55 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:15:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:15:56 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:15:56 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:15:56 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=25.1424560546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:15:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:15:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:15:56 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance c891ea66-5861-4d50-b4e1-0c20ae481fdc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:15:56 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:15:56 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:15:56 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:15:56 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:15:56 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:15:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:15:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:15:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:15:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:15:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:15:57 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:15:58 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:15:58 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:15:58 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:15:58 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:15:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:15:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:15:58 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:15:58 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid c891ea66-5861-4d50-b4e1-0c20ae481fdc {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:15:59 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updating instance_info_cache with network_info: [{"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:15:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:15:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:15:59 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:16:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:16:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:16:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:16:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:16:02 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:12 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:14 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:16:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:14 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Verify base images {{(pid=72990) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 27 04:16:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72990) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 27 04:16:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] c891ea66-5861-4d50-b4e1-0c20ae481fdc is a valid instance name {{(pid=72990) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 27 04:16:14 user nova-compute[72990]: WARNING nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e
Aug 27 04:16:14 user nova-compute[72990]: WARNING nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323
Aug 27 04:16:14 user nova-compute[72990]: WARNING nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a
Aug 27 04:16:14 user nova-compute[72990]: WARNING nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00
Aug 27 04:16:14 user nova-compute[72990]: WARNING nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052
Aug 27 04:16:14 user nova-compute[72990]: WARNING nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102
Aug 27 04:16:14 user nova-compute[72990]: WARNING nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a
Aug 27 04:16:14 user nova-compute[72990]: WARNING nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8
Aug 27 04:16:14 user nova-compute[72990]: WARNING nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7
Aug 27 04:16:14 user nova-compute[72990]: WARNING nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072
Aug 27 04:16:14 user nova-compute[72990]: INFO nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Removable base files: /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323 /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00 /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052 /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102 /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7 /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072
Aug 27 04:16:14 user nova-compute[72990]: INFO nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/73b53ba28feb0326a1ad08448642a163600f9c5e
Aug 27 04:16:14 user nova-compute[72990]: INFO nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e471bd42383ffc0a697bb6b1929507ecc4ae7323
Aug 27 04:16:14 user nova-compute[72990]: INFO nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2c9667cbd6cb029da93975572646bd36730f2d9a
Aug 27 04:16:14 user nova-compute[72990]: INFO nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3fe3d489931cd5e32427da7f63558a60e37c0c00
Aug 27 04:16:14 user nova-compute[72990]: INFO nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/34a22971449cdeda2c57bfed1dd687d30c671052
Aug 27 04:16:14 user nova-compute[72990]: INFO nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7df0faf65069ce3d2e61053d83affe17893c6102
Aug 27 04:16:14 user nova-compute[72990]: INFO nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf62bf788ed6f3aaf5163092c981344d6f55a70a
Aug 27 04:16:14 user nova-compute[72990]: INFO nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8
Aug 27 04:16:14 user nova-compute[72990]: INFO nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/50718f17bfd949d3b80d0453f5f8e3fd800864b7
Aug 27 04:16:14 user nova-compute[72990]: INFO nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/46dc696991a31238673202fe5b5eb1eb4312a072
Aug 27 04:16:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Verification complete {{(pid=72990) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 27 04:16:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Verify swap images {{(pid=72990) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 27 04:16:14 user nova-compute[72990]: DEBUG nova.virt.libvirt.imagecache [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Verify ephemeral images {{(pid=72990) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 27 04:16:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:17 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:16:20 user nova-compute[72990]: INFO nova.compute.claims [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Claim successful on node user
Aug 27 04:16:20 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG nova.network.neutron [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:16:20 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:16:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG nova.compute.manager [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:16:20 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Creating image(s)
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "/opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "/opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG nova.policy [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fc64fe032374763981adbbe658b223b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5010681c11574c4e8d64de3be1a1ebf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:20 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk 1073741824 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8,backing_fmt=raw /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk 1073741824" returned: 0 in 0.054s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "ecb65324d323189b706eb7bbb49a5b0efb4294f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecb65324d323189b706eb7bbb49a5b0efb4294f8 --force-share --output=json" returned: 0 in 0.185s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk. size=1073741824 {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG nova.virt.disk.api [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Cannot resize image /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk to a smaller size. {{(pid=72990) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Created local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Ensure instance console log exists: /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:22 user nova-compute[72990]: DEBUG nova.network.neutron [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Successfully created port: f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:16:22 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:22 user nova-compute[72990]: DEBUG nova.compute.manager [req-f51d5fac-509f-485a-9e5a-55ec442fa8de req-39d3ad0a-a44e-4793-8cb3-666c53083a85 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Received event network-changed-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:16:22 user nova-compute[72990]: DEBUG nova.compute.manager [req-f51d5fac-509f-485a-9e5a-55ec442fa8de req-39d3ad0a-a44e-4793-8cb3-666c53083a85 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Refreshing instance network info cache due to event network-changed-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:16:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f51d5fac-509f-485a-9e5a-55ec442fa8de req-39d3ad0a-a44e-4793-8cb3-666c53083a85 service nova] Acquiring lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:16:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f51d5fac-509f-485a-9e5a-55ec442fa8de req-39d3ad0a-a44e-4793-8cb3-666c53083a85 service nova] Acquired lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:16:22 user nova-compute[72990]: DEBUG nova.network.neutron [req-f51d5fac-509f-485a-9e5a-55ec442fa8de req-39d3ad0a-a44e-4793-8cb3-666c53083a85 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Refreshing network info cache for port 77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Successfully updated port: f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquired lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.network.neutron [req-f51d5fac-509f-485a-9e5a-55ec442fa8de req-39d3ad0a-a44e-4793-8cb3-666c53083a85 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updated VIF entry in instance network info cache for port 77e9607a-ea35-4a9e-8d62-9cb9ae9ee296. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.network.neutron [req-f51d5fac-509f-485a-9e5a-55ec442fa8de req-39d3ad0a-a44e-4793-8cb3-666c53083a85 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updating instance_info_cache with network_info: [{"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-f51d5fac-509f-485a-9e5a-55ec442fa8de req-39d3ad0a-a44e-4793-8cb3-666c53083a85 service nova] Releasing lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.network.neutron [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating instance_info_cache with network_info: [{"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Releasing lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.compute.manager [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Instance network_info: |[{"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Start _get_guest_xml network_info=[{"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'image_id': 'a49a9f69-b2fa-42fe-942e-afa347d26054'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:16:23 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:16:23 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T03:36:43Z,direct_url=<?>,disk_format='qcow2',id=a49a9f69-b2fa-42fe-942e-afa347d26054,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1261fcea31c84dcc85c1c48bca6d4fea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T03:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1125722199',display_name='tempest-SnapshotDataIntegrityTests-server-1125722199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1125722199',id=51,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE42KvVRD/0I0fmleXo8oBTd7kchFkxn/01OfD9x8Jo0rMAIJlANcF0uhl9uvsUWybg6GlWpkcDul9N0uLFsycGgQXQa4EDDaZ5WmQecPRjiCAzeKc0ces2cHXZT94+jJA==',key_name='tempest-keypair-551016695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5010681c11574c4e8d64de3be1a1ebf8',ramdisk_id='',reservation_id='r-vsjkbq7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1361664179',owner_user_name='tempest-SnapshotDataIntegrityTests-1361664179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc64fe032374763981adbbe658b223b',uuid=3a714f8e-55be-4b7b-9ba6-18f7559575be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Converting VIF {"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5e:b3,bridge_name='br-int',has_traffic_filtering=True,id=f2dfac59-e892-409d-b01e-ee4f2c9ed397,network=Network(0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dfac59-e8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.objects.instance [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:16:23 user nova-compute[72990]:   <uuid>3a714f8e-55be-4b7b-9ba6-18f7559575be</uuid>
Aug 27 04:16:23 user nova-compute[72990]:   <name>instance-00000033</name>
Aug 27 04:16:23 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:16:23 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:16:23 user nova-compute[72990]:   <metadata>
Aug 27 04:16:23 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:16:23 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:16:23 user nova-compute[72990]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1125722199</nova:name>
Aug 27 04:16:23 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:16:23</nova:creationTime>
Aug 27 04:16:23 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:16:23 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:16:23 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:16:23 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:16:23 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:16:23 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:16:23 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:16:23 user nova-compute[72990]:       <nova:owner>
Aug 27 04:16:23 user nova-compute[72990]:         <nova:user uuid="6fc64fe032374763981adbbe658b223b">tempest-SnapshotDataIntegrityTests-1361664179-project-member</nova:user>
Aug 27 04:16:23 user nova-compute[72990]:         <nova:project uuid="5010681c11574c4e8d64de3be1a1ebf8">tempest-SnapshotDataIntegrityTests-1361664179</nova:project>
Aug 27 04:16:23 user nova-compute[72990]:       </nova:owner>
Aug 27 04:16:23 user nova-compute[72990]:       <nova:root type="image" uuid="a49a9f69-b2fa-42fe-942e-afa347d26054"/>
Aug 27 04:16:23 user nova-compute[72990]:       <nova:ports>
Aug 27 04:16:23 user nova-compute[72990]:         <nova:port uuid="f2dfac59-e892-409d-b01e-ee4f2c9ed397">
Aug 27 04:16:23 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 04:16:23 user nova-compute[72990]:         </nova:port>
Aug 27 04:16:23 user nova-compute[72990]:       </nova:ports>
Aug 27 04:16:23 user nova-compute[72990]:     </nova:instance>
Aug 27 04:16:23 user nova-compute[72990]:   </metadata>
Aug 27 04:16:23 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:16:23 user nova-compute[72990]:     <system>
Aug 27 04:16:23 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:16:23 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:16:23 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:16:23 user nova-compute[72990]:       <entry name="serial">3a714f8e-55be-4b7b-9ba6-18f7559575be</entry>
Aug 27 04:16:23 user nova-compute[72990]:       <entry name="uuid">3a714f8e-55be-4b7b-9ba6-18f7559575be</entry>
Aug 27 04:16:23 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:16:23 user nova-compute[72990]:     </system>
Aug 27 04:16:23 user nova-compute[72990]:   </sysinfo>
Aug 27 04:16:23 user nova-compute[72990]:   <os>
Aug 27 04:16:23 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:16:23 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:16:23 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:16:23 user nova-compute[72990]:   </os>
Aug 27 04:16:23 user nova-compute[72990]:   <features>
Aug 27 04:16:23 user nova-compute[72990]:     <acpi/>
Aug 27 04:16:23 user nova-compute[72990]:     <apic/>
Aug 27 04:16:23 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:16:23 user nova-compute[72990]:   </features>
Aug 27 04:16:23 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:16:23 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:16:23 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:16:23 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:16:23 user nova-compute[72990]:   </clock>
Aug 27 04:16:23 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:16:23 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:16:23 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:16:23 user nova-compute[72990]:   </cpu>
Aug 27 04:16:23 user nova-compute[72990]:   <devices>
Aug 27 04:16:23 user nova-compute[72990]:     <disk type="file" device="disk">
Aug 27 04:16:23 user nova-compute[72990]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:16:23 user nova-compute[72990]:       <source file="/opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk"/>
Aug 27 04:16:23 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:16:23 user nova-compute[72990]:     </disk>
Aug 27 04:16:23 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:16:23 user nova-compute[72990]:       <mac address="fa:16:3e:bc:5e:b3"/>
Aug 27 04:16:23 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:16:23 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:16:23 user nova-compute[72990]:       <target dev="tapf2dfac59-e8"/>
Aug 27 04:16:23 user nova-compute[72990]:     </interface>
Aug 27 04:16:23 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:16:23 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/console.log" append="off"/>
Aug 27 04:16:23 user nova-compute[72990]:     </serial>
Aug 27 04:16:23 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:16:23 user nova-compute[72990]:     <video>
Aug 27 04:16:23 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:16:23 user nova-compute[72990]:     </video>
Aug 27 04:16:23 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:16:23 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:16:23 user nova-compute[72990]:     </rng>
Aug 27 04:16:23 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:16:23 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:16:23 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:16:23 user nova-compute[72990]:     </memballoon>
Aug 27 04:16:23 user nova-compute[72990]:   </devices>
Aug 27 04:16:23 user nova-compute[72990]: </domain>
Aug 27 04:16:23 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1125722199',display_name='tempest-SnapshotDataIntegrityTests-server-1125722199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1125722199',id=51,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE42KvVRD/0I0fmleXo8oBTd7kchFkxn/01OfD9x8Jo0rMAIJlANcF0uhl9uvsUWybg6GlWpkcDul9N0uLFsycGgQXQa4EDDaZ5WmQecPRjiCAzeKc0ces2cHXZT94+jJA==',key_name='tempest-keypair-551016695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5010681c11574c4e8d64de3be1a1ebf8',ramdisk_id='',reservation_id='r-vsjkbq7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1361664179',owner_user_name='tempest-SnapshotDataIntegrityTests-1361664179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc64fe032374763981adbbe658b223b',uuid=3a714f8e-55be-4b7b-9ba6-18f7559575be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Converting VIF {"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5e:b3,bridge_name='br-int',has_traffic_filtering=True,id=f2dfac59-e892-409d-b01e-ee4f2c9ed397,network=Network(0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dfac59-e8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG os_vif [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5e:b3,bridge_name='br-int',has_traffic_filtering=True,id=f2dfac59-e892-409d-b01e-ee4f2c9ed397,network=Network(0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dfac59-e8') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2dfac59-e8, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:16:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2dfac59-e8, col_values=(('external_ids', {'iface-id': 'f2dfac59-e892-409d-b01e-ee4f2c9ed397', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:5e:b3', 'vm-uuid': '3a714f8e-55be-4b7b-9ba6-18f7559575be'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:16:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:16:24 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:24 user nova-compute[72990]: INFO os_vif [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5e:b3,bridge_name='br-int',has_traffic_filtering=True,id=f2dfac59-e892-409d-b01e-ee4f2c9ed397,network=Network(0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dfac59-e8')
Aug 27 04:16:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:16:24 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No VIF found with MAC fa:16:3e:bc:5e:b3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:16:24 user nova-compute[72990]: DEBUG nova.compute.manager [req-16f8549f-7612-4e1b-81ae-7ad931d3600c req-a28bf86c-2d7f-4e04-898d-db68b16842ad service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Received event network-changed-f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:16:24 user nova-compute[72990]: DEBUG nova.compute.manager [req-16f8549f-7612-4e1b-81ae-7ad931d3600c req-a28bf86c-2d7f-4e04-898d-db68b16842ad service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Refreshing instance network info cache due to event network-changed-f2dfac59-e892-409d-b01e-ee4f2c9ed397. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:16:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-16f8549f-7612-4e1b-81ae-7ad931d3600c req-a28bf86c-2d7f-4e04-898d-db68b16842ad service nova] Acquiring lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:16:24 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-16f8549f-7612-4e1b-81ae-7ad931d3600c req-a28bf86c-2d7f-4e04-898d-db68b16842ad service nova] Acquired lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:16:24 user nova-compute[72990]: DEBUG nova.network.neutron [req-16f8549f-7612-4e1b-81ae-7ad931d3600c req-a28bf86c-2d7f-4e04-898d-db68b16842ad service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Refreshing network info cache for port f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:16:25 user nova-compute[72990]: DEBUG nova.network.neutron [req-16f8549f-7612-4e1b-81ae-7ad931d3600c req-a28bf86c-2d7f-4e04-898d-db68b16842ad service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updated VIF entry in instance network info cache for port f2dfac59-e892-409d-b01e-ee4f2c9ed397. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:16:25 user nova-compute[72990]: DEBUG nova.network.neutron [req-16f8549f-7612-4e1b-81ae-7ad931d3600c req-a28bf86c-2d7f-4e04-898d-db68b16842ad service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating instance_info_cache with network_info: [{"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:16:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-16f8549f-7612-4e1b-81ae-7ad931d3600c req-a28bf86c-2d7f-4e04-898d-db68b16842ad service nova] Releasing lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:16:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-60cfc23a-c04f-4eb5-aa8c-f658fb1eaca5 req-b827edb8-6596-493b-82e6-e01ebe9be1a4 service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Received event network-vif-plugged-f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:16:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-60cfc23a-c04f-4eb5-aa8c-f658fb1eaca5 req-b827edb8-6596-493b-82e6-e01ebe9be1a4 service nova] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-60cfc23a-c04f-4eb5-aa8c-f658fb1eaca5 req-b827edb8-6596-493b-82e6-e01ebe9be1a4 service nova] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:25 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-60cfc23a-c04f-4eb5-aa8c-f658fb1eaca5 req-b827edb8-6596-493b-82e6-e01ebe9be1a4 service nova] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:25 user nova-compute[72990]: DEBUG nova.compute.manager [req-60cfc23a-c04f-4eb5-aa8c-f658fb1eaca5 req-b827edb8-6596-493b-82e6-e01ebe9be1a4 service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] No waiting events found dispatching network-vif-plugged-f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:16:25 user nova-compute[72990]: WARNING nova.compute.manager [req-60cfc23a-c04f-4eb5-aa8c-f658fb1eaca5 req-b827edb8-6596-493b-82e6-e01ebe9be1a4 service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Received unexpected event network-vif-plugged-f2dfac59-e892-409d-b01e-ee4f2c9ed397 for instance with vm_state building and task_state spawning.
Aug 27 04:16:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109787.4726386, 3a714f8e-55be-4b7b-9ba6-18f7559575be => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:16:27 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] VM Resumed (Lifecycle Event)
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:16:27 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Instance spawned successfully.
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:16:27 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109787.477615, 3a714f8e-55be-4b7b-9ba6-18f7559575be => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:16:27 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] VM Started (Lifecycle Event)
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:16:27 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:16:27 user nova-compute[72990]: INFO nova.compute.manager [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Took 7.00 seconds to spawn the instance on the hypervisor.
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.compute.manager [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-3230ff90-c1d9-4cfc-b65f-b2674a80e578 req-812772ea-b392-4005-8630-57e96da53cc4 service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Received event network-vif-plugged-f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3230ff90-c1d9-4cfc-b65f-b2674a80e578 req-812772ea-b392-4005-8630-57e96da53cc4 service nova] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3230ff90-c1d9-4cfc-b65f-b2674a80e578 req-812772ea-b392-4005-8630-57e96da53cc4 service nova] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3230ff90-c1d9-4cfc-b65f-b2674a80e578 req-812772ea-b392-4005-8630-57e96da53cc4 service nova] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:27 user nova-compute[72990]: DEBUG nova.compute.manager [req-3230ff90-c1d9-4cfc-b65f-b2674a80e578 req-812772ea-b392-4005-8630-57e96da53cc4 service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] No waiting events found dispatching network-vif-plugged-f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:16:27 user nova-compute[72990]: WARNING nova.compute.manager [req-3230ff90-c1d9-4cfc-b65f-b2674a80e578 req-812772ea-b392-4005-8630-57e96da53cc4 service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Received unexpected event network-vif-plugged-f2dfac59-e892-409d-b01e-ee4f2c9ed397 for instance with vm_state building and task_state spawning.
Aug 27 04:16:27 user nova-compute[72990]: INFO nova.compute.manager [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Took 7.51 seconds to build instance.
Aug 27 04:16:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-78978c3c-a6be-451b-95c0-79061ab13132 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.614s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:34 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "6210037b-bf64-40f8-a11e-df0eca4a432c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:38 user nova-compute[72990]: DEBUG nova.compute.manager [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Starting instance... {{(pid=72990) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:16:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:38 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:38 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72990) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:16:38 user nova-compute[72990]: INFO nova.compute.claims [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Claim successful on node user
Aug 27 04:16:39 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Start building networks asynchronously for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Allocating IP information in the background. {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG nova.network.neutron [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] allocate_for_instance() {{(pid=72990) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:16:39 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:16:39 user nova-compute[72990]: DEBUG nova.compute.manager [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Start building block device mappings for instance. {{(pid=72990) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:16:39 user nova-compute[72990]: INFO nova.virt.block_device [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Booting with volume 14b512e6-db40-4aab-bb5e-9af7978de4ea at /dev/vda
Aug 27 04:16:39 user nova-compute[72990]: DEBUG nova.policy [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf3112e616344af7873a50d134260637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6b19a372f947e4aee43f9d7573e8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72990) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG os_brick.utils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba43f8ee-65d9-4d88-89de-8eaa8d8d0591]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[faebcc3b-0ee1-46c3-82ef-3e6aea1b01d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbae4c19-0cd5-41ce-9d85-c6c0075542df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c892b9-091b-4b07-9c5d-cb7611f4e5f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:16:39 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:16:39 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[86739eea-7c98-43b9-98f9-e2182833b3fb]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG os_brick.utils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:16:39 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Updating existing volume attachment record: b8bb4dd6-a951-4cad-a0ed-2769d5a6a6be {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:16:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:40 user nova-compute[72990]: DEBUG nova.network.neutron [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Successfully created port: f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Successfully updated port: f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "refresh_cache-6210037b-bf64-40f8-a11e-df0eca4a432c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquired lock "refresh_cache-6210037b-bf64-40f8-a11e-df0eca4a432c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Building network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-9db4165b-9fe1-4274-a412-875e4406771a req-7504f84e-bb48-457b-b238-c4a1ccb3d4ab service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Received event network-changed-f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG nova.compute.manager [req-9db4165b-9fe1-4274-a412-875e4406771a req-7504f84e-bb48-457b-b238-c4a1ccb3d4ab service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Refreshing instance network info cache due to event network-changed-f7401d0a-fae9-41c3-acf8-b572e611688a. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9db4165b-9fe1-4274-a412-875e4406771a req-7504f84e-bb48-457b-b238-c4a1ccb3d4ab service nova] Acquiring lock "refresh_cache-6210037b-bf64-40f8-a11e-df0eca4a432c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Instance cache missing network info. {{(pid=72990) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG nova.network.neutron [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Updating instance_info_cache with network_info: [{"id": "f7401d0a-fae9-41c3-acf8-b572e611688a", "address": "fa:16:3e:aa:5c:14", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7401d0a-fa", "ovs_interfaceid": "f7401d0a-fae9-41c3-acf8-b572e611688a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Releasing lock "refresh_cache-6210037b-bf64-40f8-a11e-df0eca4a432c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG nova.compute.manager [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Instance network_info: |[{"id": "f7401d0a-fae9-41c3-acf8-b572e611688a", "address": "fa:16:3e:aa:5c:14", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7401d0a-fa", "ovs_interfaceid": "f7401d0a-fae9-41c3-acf8-b572e611688a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72990) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9db4165b-9fe1-4274-a412-875e4406771a req-7504f84e-bb48-457b-b238-c4a1ccb3d4ab service nova] Acquired lock "refresh_cache-6210037b-bf64-40f8-a11e-df0eca4a432c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG nova.network.neutron [req-9db4165b-9fe1-4274-a412-875e4406771a req-7504f84e-bb48-457b-b238-c4a1ccb3d4ab service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Refreshing network info cache for port f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG nova.network.neutron [req-9db4165b-9fe1-4274-a412-875e4406771a req-7504f84e-bb48-457b-b238-c4a1ccb3d4ab service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Updated VIF entry in instance network info cache for port f7401d0a-fae9-41c3-acf8-b572e611688a. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG nova.network.neutron [req-9db4165b-9fe1-4274-a412-875e4406771a req-7504f84e-bb48-457b-b238-c4a1ccb3d4ab service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Updating instance_info_cache with network_info: [{"id": "f7401d0a-fae9-41c3-acf8-b572e611688a", "address": "fa:16:3e:aa:5c:14", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7401d0a-fa", "ovs_interfaceid": "f7401d0a-fae9-41c3-acf8-b572e611688a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:16:41 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9db4165b-9fe1-4274-a412-875e4406771a req-7504f84e-bb48-457b-b238-c4a1ccb3d4ab service nova] Releasing lock "refresh_cache-6210037b-bf64-40f8-a11e-df0eca4a432c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:16:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:44 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:49 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:49 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.compute.manager [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Start spawning the instance on the hypervisor. {{(pid=72990) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Creating instance directory {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:16:50 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Creating image(s)
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Did not create local disks {{(pid=72990) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Ensure instance console log exists: /opt/stack/data/nova/instances/6210037b-bf64-40f8-a11e-df0eca4a432c/console.log {{(pid=72990) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Start _get_guest_xml network_info=[{"id": "f7401d0a-fae9-41c3-acf8-b572e611688a", "address": "fa:16:3e:aa:5c:14", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7401d0a-fa", "ovs_interfaceid": "f7401d0a-fae9-41c3-acf8-b572e611688a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'b8bb4dd6-a951-4cad-a0ed-2769d5a6a6be', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtgDPQbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6210037b-bf64-40f8-a11e-df0eca4a432c', 'attached_at': '', 'detached_at': '', 'volume_id': '14b512e6-db40-4aab-bb5e-9af7978de4ea', 'serial': '14b512e6-db40-4aab-bb5e-9af7978de4ea'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:16:50 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:16:50 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU controller missing on host. {{(pid=72990) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.host [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU controller found on host. {{(pid=72990) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72990) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T03:36:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flavor limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Image limits 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flavor pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Image pref 0:0:0 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72990) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Got 1 possible topologies {{(pid=72990) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.hardware [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72990) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtgDPQbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:16:50 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:16:50 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:16:50 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcd5621-8ec4-49a2-918c-3253845d78d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:16:50 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[664e25b3-e42e-4975-9b2e-4890bfc98162]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea] added
Aug 27 04:16:50 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2280d124-d82c-4d58-a5c4-69a97be73ec0]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3f5c8d-aab1-4856-9f29-6f8421f79bd6]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtgDPQbU {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtgDPQbU" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4affcee4-f2a5-4e42-9262-02ea7f24ce78]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MtgDPQbU'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cd58a9-252e-487b-841f-f371750a6d3c]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd592d4c-292e-4ce9-825b-27e48951473f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:16:50 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:16:50 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eb6344-127c-4f85-81d8-8b959ad812b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea, portal: 172.16.0.220,3260]
Aug 27 04:16:50 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea, portal: 172.16.0.220,3260] successful.
Aug 27 04:16:50 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eca10b8-8668-4e8e-b441-e00685d22236]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea6c918-b62b-4ff5-9bd6-230a5ba047c0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:16:50 user nova-compute[72990]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea (non-flash)
Aug 27 04:16:50 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:16:50 user nova-compute[72990]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea (non-flash)
Aug 27 04:16:50 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db011b-3c99-4b9b-bd3e-104737f4ed2e]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:16:50 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtgDPQbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23165326530356563', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165326530356563', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:16:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1775112625',display_name='tempest-TestVolumeBootPattern-server-1775112625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1775112625',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAxiq8nzDuLrhlX90KCpMhjjdu00EEsfsUBjmDNf2QVNBgoIetJr5kJSGJfbGHc1lKfJ77a4En5IQ+5dvysFKDT9aLp7EGC0j0/Z1Ri5VH2ji/z9XR9yuImUkcGl95llA==',key_name='tempest-TestVolumeBootPattern-1921423690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-phukgx84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:16:39Z,user_data=None,user_id='cf3112e616344af7873a50d134260637',uuid=6210037b-bf64-40f8-a11e-df0eca4a432c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7401d0a-fae9-41c3-acf8-b572e611688a", "address": "fa:16:3e:aa:5c:14", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7401d0a-fa", "ovs_interfaceid": "f7401d0a-fae9-41c3-acf8-b572e611688a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72990) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "f7401d0a-fae9-41c3-acf8-b572e611688a", "address": "fa:16:3e:aa:5c:14", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7401d0a-fa", "ovs_interfaceid": "f7401d0a-fae9-41c3-acf8-b572e611688a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5c:14,bridge_name='br-int',has_traffic_filtering=True,id=f7401d0a-fae9-41c3-acf8-b572e611688a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7401d0a-fa') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG nova.objects.instance [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lazy-loading 'pci_devices' on Instance uuid 6210037b-bf64-40f8-a11e-df0eca4a432c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:16:51 user nova-compute[72990]:   <uuid>6210037b-bf64-40f8-a11e-df0eca4a432c</uuid>
Aug 27 04:16:51 user nova-compute[72990]:   <name>instance-00000034</name>
Aug 27 04:16:51 user nova-compute[72990]:   <memory>524288</memory>
Aug 27 04:16:51 user nova-compute[72990]:   <vcpu>1</vcpu>
Aug 27 04:16:51 user nova-compute[72990]:   <metadata>
Aug 27 04:16:51 user nova-compute[72990]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:16:51 user nova-compute[72990]:       <nova:package version="0.0.0"/>
Aug 27 04:16:51 user nova-compute[72990]:       <nova:name>tempest-TestVolumeBootPattern-server-1775112625</nova:name>
Aug 27 04:16:51 user nova-compute[72990]:       <nova:creationTime>2023-08-27 04:16:50</nova:creationTime>
Aug 27 04:16:51 user nova-compute[72990]:       <nova:flavor name="m1.tiny">
Aug 27 04:16:51 user nova-compute[72990]:         <nova:memory>512</nova:memory>
Aug 27 04:16:51 user nova-compute[72990]:         <nova:disk>1</nova:disk>
Aug 27 04:16:51 user nova-compute[72990]:         <nova:swap>0</nova:swap>
Aug 27 04:16:51 user nova-compute[72990]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:16:51 user nova-compute[72990]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:16:51 user nova-compute[72990]:       </nova:flavor>
Aug 27 04:16:51 user nova-compute[72990]:       <nova:owner>
Aug 27 04:16:51 user nova-compute[72990]:         <nova:user uuid="cf3112e616344af7873a50d134260637">tempest-TestVolumeBootPattern-1834919775-project-member</nova:user>
Aug 27 04:16:51 user nova-compute[72990]:         <nova:project uuid="6d6b19a372f947e4aee43f9d7573e8f7">tempest-TestVolumeBootPattern-1834919775</nova:project>
Aug 27 04:16:51 user nova-compute[72990]:       </nova:owner>
Aug 27 04:16:51 user nova-compute[72990]:       <nova:ports>
Aug 27 04:16:51 user nova-compute[72990]:         <nova:port uuid="f7401d0a-fae9-41c3-acf8-b572e611688a">
Aug 27 04:16:51 user nova-compute[72990]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 04:16:51 user nova-compute[72990]:         </nova:port>
Aug 27 04:16:51 user nova-compute[72990]:       </nova:ports>
Aug 27 04:16:51 user nova-compute[72990]:     </nova:instance>
Aug 27 04:16:51 user nova-compute[72990]:   </metadata>
Aug 27 04:16:51 user nova-compute[72990]:   <sysinfo type="smbios">
Aug 27 04:16:51 user nova-compute[72990]:     <system>
Aug 27 04:16:51 user nova-compute[72990]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:16:51 user nova-compute[72990]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:16:51 user nova-compute[72990]:       <entry name="version">0.0.0</entry>
Aug 27 04:16:51 user nova-compute[72990]:       <entry name="serial">6210037b-bf64-40f8-a11e-df0eca4a432c</entry>
Aug 27 04:16:51 user nova-compute[72990]:       <entry name="uuid">6210037b-bf64-40f8-a11e-df0eca4a432c</entry>
Aug 27 04:16:51 user nova-compute[72990]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:16:51 user nova-compute[72990]:     </system>
Aug 27 04:16:51 user nova-compute[72990]:   </sysinfo>
Aug 27 04:16:51 user nova-compute[72990]:   <os>
Aug 27 04:16:51 user nova-compute[72990]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:16:51 user nova-compute[72990]:     <boot dev="hd"/>
Aug 27 04:16:51 user nova-compute[72990]:     <smbios mode="sysinfo"/>
Aug 27 04:16:51 user nova-compute[72990]:   </os>
Aug 27 04:16:51 user nova-compute[72990]:   <features>
Aug 27 04:16:51 user nova-compute[72990]:     <acpi/>
Aug 27 04:16:51 user nova-compute[72990]:     <apic/>
Aug 27 04:16:51 user nova-compute[72990]:     <vmcoreinfo/>
Aug 27 04:16:51 user nova-compute[72990]:   </features>
Aug 27 04:16:51 user nova-compute[72990]:   <clock offset="utc">
Aug 27 04:16:51 user nova-compute[72990]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:16:51 user nova-compute[72990]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:16:51 user nova-compute[72990]:     <timer name="hpet" present="no"/>
Aug 27 04:16:51 user nova-compute[72990]:   </clock>
Aug 27 04:16:51 user nova-compute[72990]:   <cpu mode="custom" match="exact">
Aug 27 04:16:51 user nova-compute[72990]:     <model>Nehalem</model>
Aug 27 04:16:51 user nova-compute[72990]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:16:51 user nova-compute[72990]:   </cpu>
Aug 27 04:16:51 user nova-compute[72990]:   <devices>
Aug 27 04:16:51 user nova-compute[72990]:     <disk type="block" device="disk">
Aug 27 04:16:51 user nova-compute[72990]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:16:51 user nova-compute[72990]:       <source dev="/dev/sdb"/>
Aug 27 04:16:51 user nova-compute[72990]:       <target dev="vda" bus="virtio"/>
Aug 27 04:16:51 user nova-compute[72990]:       <serial>14b512e6-db40-4aab-bb5e-9af7978de4ea</serial>
Aug 27 04:16:51 user nova-compute[72990]:     </disk>
Aug 27 04:16:51 user nova-compute[72990]:     <interface type="ethernet">
Aug 27 04:16:51 user nova-compute[72990]:       <mac address="fa:16:3e:aa:5c:14"/>
Aug 27 04:16:51 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:16:51 user nova-compute[72990]:       <mtu size="1442"/>
Aug 27 04:16:51 user nova-compute[72990]:       <target dev="tapf7401d0a-fa"/>
Aug 27 04:16:51 user nova-compute[72990]:     </interface>
Aug 27 04:16:51 user nova-compute[72990]:     <serial type="pty">
Aug 27 04:16:51 user nova-compute[72990]:       <log file="/opt/stack/data/nova/instances/6210037b-bf64-40f8-a11e-df0eca4a432c/console.log" append="off"/>
Aug 27 04:16:51 user nova-compute[72990]:     </serial>
Aug 27 04:16:51 user nova-compute[72990]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:16:51 user nova-compute[72990]:     <video>
Aug 27 04:16:51 user nova-compute[72990]:       <model type="virtio"/>
Aug 27 04:16:51 user nova-compute[72990]:     </video>
Aug 27 04:16:51 user nova-compute[72990]:     <rng model="virtio">
Aug 27 04:16:51 user nova-compute[72990]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:16:51 user nova-compute[72990]:     </rng>
Aug 27 04:16:51 user nova-compute[72990]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:16:51 user nova-compute[72990]:     <memballoon model="virtio">
Aug 27 04:16:51 user nova-compute[72990]:       <stats period="10"/>
Aug 27 04:16:51 user nova-compute[72990]:     </memballoon>
Aug 27 04:16:51 user nova-compute[72990]:   </devices>
Aug 27 04:16:51 user nova-compute[72990]: </domain>
Aug 27 04:16:51 user nova-compute[72990]:  {{(pid=72990) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:16:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1775112625',display_name='tempest-TestVolumeBootPattern-server-1775112625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1775112625',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAxiq8nzDuLrhlX90KCpMhjjdu00EEsfsUBjmDNf2QVNBgoIetJr5kJSGJfbGHc1lKfJ77a4En5IQ+5dvysFKDT9aLp7EGC0j0/Z1Ri5VH2ji/z9XR9yuImUkcGl95llA==',key_name='tempest-TestVolumeBootPattern-1921423690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-phukgx84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:16:39Z,user_data=None,user_id='cf3112e616344af7873a50d134260637',uuid=6210037b-bf64-40f8-a11e-df0eca4a432c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7401d0a-fae9-41c3-acf8-b572e611688a", "address": "fa:16:3e:aa:5c:14", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7401d0a-fa", "ovs_interfaceid": "f7401d0a-fae9-41c3-acf8-b572e611688a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "f7401d0a-fae9-41c3-acf8-b572e611688a", "address": "fa:16:3e:aa:5c:14", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7401d0a-fa", "ovs_interfaceid": "f7401d0a-fae9-41c3-acf8-b572e611688a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5c:14,bridge_name='br-int',has_traffic_filtering=True,id=f7401d0a-fae9-41c3-acf8-b572e611688a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7401d0a-fa') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG os_vif [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5c:14,bridge_name='br-int',has_traffic_filtering=True,id=f7401d0a-fae9-41c3-acf8-b572e611688a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7401d0a-fa') {{(pid=72990) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7401d0a-fa, may_exist=True, interface_attrs={}) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7401d0a-fa, col_values=(('external_ids', {'iface-id': 'f7401d0a-fae9-41c3-acf8-b572e611688a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:5c:14', 'vm-uuid': '6210037b-bf64-40f8-a11e-df0eca4a432c'}),), if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:16:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:51 user nova-compute[72990]: INFO os_vif [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5c:14,bridge_name='br-int',has_traffic_filtering=True,id=f7401d0a-fae9-41c3-acf8-b572e611688a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7401d0a-fa')
Aug 27 04:16:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:16:52 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] No VIF found with MAC fa:16:3e:aa:5c:14, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:16:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:16:52 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:16:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-549e4af7-eaa1-4afa-99f7-518e1b4af21b req-7a1ef727-6797-498b-9e45-d57142780c79 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Received event network-vif-plugged-f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:16:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-549e4af7-eaa1-4afa-99f7-518e1b4af21b req-7a1ef727-6797-498b-9e45-d57142780c79 service nova] Acquiring lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-549e4af7-eaa1-4afa-99f7-518e1b4af21b req-7a1ef727-6797-498b-9e45-d57142780c79 service nova] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:53 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-549e4af7-eaa1-4afa-99f7-518e1b4af21b req-7a1ef727-6797-498b-9e45-d57142780c79 service nova] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:53 user nova-compute[72990]: DEBUG nova.compute.manager [req-549e4af7-eaa1-4afa-99f7-518e1b4af21b req-7a1ef727-6797-498b-9e45-d57142780c79 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] No waiting events found dispatching network-vif-plugged-f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:16:53 user nova-compute[72990]: WARNING nova.compute.manager [req-549e4af7-eaa1-4afa-99f7-518e1b4af21b req-7a1ef727-6797-498b-9e45-d57142780c79 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Received unexpected event network-vif-plugged-f7401d0a-fae9-41c3-acf8-b572e611688a for instance with vm_state building and task_state spawning.
Aug 27 04:16:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:16:54 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109815.2887337, 6210037b-bf64-40f8-a11e-df0eca4a432c => Resumed> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:16:55 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] VM Resumed (Lifecycle Event)
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Instance event wait completed in 0 seconds for  {{(pid=72990) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Guest created on hypervisor {{(pid=72990) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:16:55 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Instance spawned successfully.
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Found default for hw_cdrom_bus of ide {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Found default for hw_disk_bus of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Found default for hw_input_bus of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Found default for hw_pointer_model of None {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Found default for hw_video_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Found default for hw_vif_model of virtio {{(pid=72990) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:16:55 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.virt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Emitting event <LifecycleEvent: 1693109815.290042, 6210037b-bf64-40f8-a11e-df0eca4a432c => Started> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:16:55 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] VM Started (Lifecycle Event)
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72990) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:16:55 user nova-compute[72990]: INFO nova.compute.manager [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:16:55 user nova-compute[72990]: INFO nova.compute.manager [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.compute.manager [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:16:55 user nova-compute[72990]: INFO nova.compute.manager [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Took 16.63 seconds to build instance.
Aug 27 04:16:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-12883187-23d5-4d0d-854e-396d8ba835da tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.731s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9f51d528-5c72-4743-bb6a-5462d552a1c2 req-4aaddfca-f7e4-4883-8825-cc21acaa369e service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Received event network-vif-plugged-f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9f51d528-5c72-4743-bb6a-5462d552a1c2 req-4aaddfca-f7e4-4883-8825-cc21acaa369e service nova] Acquiring lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9f51d528-5c72-4743-bb6a-5462d552a1c2 req-4aaddfca-f7e4-4883-8825-cc21acaa369e service nova] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9f51d528-5c72-4743-bb6a-5462d552a1c2 req-4aaddfca-f7e4-4883-8825-cc21acaa369e service nova] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.compute.manager [req-9f51d528-5c72-4743-bb6a-5462d552a1c2 req-4aaddfca-f7e4-4883-8825-cc21acaa369e service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] No waiting events found dispatching network-vif-plugged-f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:16:55 user nova-compute[72990]: WARNING nova.compute.manager [req-9f51d528-5c72-4743-bb6a-5462d552a1c2 req-4aaddfca-f7e4-4883-8825-cc21acaa369e service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Received unexpected event network-vif-plugged-f7401d0a-fae9-41c3-acf8-b572e611688a for instance with vm_state active and task_state None.
Aug 27 04:16:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:55 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:16:56 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:16:56 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:16:56 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8546MB free_disk=25.102584838867188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance c891ea66-5861-4d50-b4e1-0c20ae481fdc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 3a714f8e-55be-4b7b-9ba6-18f7559575be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 6210037b-bf64-40f8-a11e-df0eca4a432c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing inventories for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating ProviderTree inventory for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating inventory in ProviderTree for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:56 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing aggregate associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, aggregates: None {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 04:16:57 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing trait associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 04:16:57 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:16:57 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:16:57 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:16:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:16:57 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:16:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 04:16:57 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] There are 0 instances to clean {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 04:16:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:16:59 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:16:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:16:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:16:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:16:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:16:59 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:16:59 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid c891ea66-5861-4d50-b4e1-0c20ae481fdc {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:16:59 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updating instance_info_cache with network_info: [{"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:16:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:16:59 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:16:59 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:16:59 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:17:01 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:17:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:17:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid c891ea66-5861-4d50-b4e1-0c20ae481fdc {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Triggering sync for uuid 6210037b-bf64-40f8-a11e-df0eca4a432c {{(pid=72990) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "6210037b-bf64-40f8-a11e-df0eca4a432c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:17:10 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:17:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:21 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:17:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:30 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:17:30 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72990) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 04:17:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:41 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:46 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:49 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:17:51 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:17:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:17:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:17:56 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:17:56 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:17:57 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:17:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:17:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:17:57 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:17:57 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:17:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:17:57 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:17:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:17:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:17:57 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:17:58 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:17:58 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:17:58 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:17:58 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8577MB free_disk=25.101829528808594GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:17:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:17:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:17:58 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance c891ea66-5861-4d50-b4e1-0c20ae481fdc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:17:58 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 3a714f8e-55be-4b7b-9ba6-18f7559575be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:17:58 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 6210037b-bf64-40f8-a11e-df0eca4a432c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:17:58 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:17:58 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:17:58 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:17:58 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:17:58 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:17:58 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:17:59 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:18:00 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:18:00 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:18:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:18:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:18:00 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:18:01 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating instance_info_cache with network_info: [{"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:18:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:18:01 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:18:01 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:18:01 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:03 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:18:06 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:18:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-9812b1ca-dda9-47be-bd1e-87e7d3179cd3 req-f7ec9eb8-3325-475d-bb99-9263b16fa1ba service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Received event network-changed-f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:18:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-9812b1ca-dda9-47be-bd1e-87e7d3179cd3 req-f7ec9eb8-3325-475d-bb99-9263b16fa1ba service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Refreshing instance network info cache due to event network-changed-f2dfac59-e892-409d-b01e-ee4f2c9ed397. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:18:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9812b1ca-dda9-47be-bd1e-87e7d3179cd3 req-f7ec9eb8-3325-475d-bb99-9263b16fa1ba service nova] Acquiring lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:18:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9812b1ca-dda9-47be-bd1e-87e7d3179cd3 req-f7ec9eb8-3325-475d-bb99-9263b16fa1ba service nova] Acquired lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:18:11 user nova-compute[72990]: DEBUG nova.network.neutron [req-9812b1ca-dda9-47be-bd1e-87e7d3179cd3 req-f7ec9eb8-3325-475d-bb99-9263b16fa1ba service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Refreshing network info cache for port f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:18:11 user nova-compute[72990]: DEBUG nova.network.neutron [req-9812b1ca-dda9-47be-bd1e-87e7d3179cd3 req-f7ec9eb8-3325-475d-bb99-9263b16fa1ba service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updated VIF entry in instance network info cache for port f2dfac59-e892-409d-b01e-ee4f2c9ed397. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:18:11 user nova-compute[72990]: DEBUG nova.network.neutron [req-9812b1ca-dda9-47be-bd1e-87e7d3179cd3 req-f7ec9eb8-3325-475d-bb99-9263b16fa1ba service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating instance_info_cache with network_info: [{"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:18:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-9812b1ca-dda9-47be-bd1e-87e7d3179cd3 req-f7ec9eb8-3325-475d-bb99-9263b16fa1ba service nova] Releasing lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:18:11 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:18:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:18:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:18:16 user nova-compute[72990]: DEBUG nova.objects.instance [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'flavor' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:18:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:18:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:18:16 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:18:16 user nova-compute[72990]: INFO nova.compute.manager [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attaching volume 2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd to /dev/vdb
Aug 27 04:18:16 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG os_brick.utils [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e959a8e0-acb5-48a2-aadb-f197d95f968b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0807a2-8407-49d3-a599-33a53b852840]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b9049e-4e05-4fae-8e66-bf8dcad685f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[64562b8d-5a57-4bc1-93d0-589cda4503c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:18:17 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:18:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65050ea-78cb-4348-aa60-4adeece47e28]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG os_brick.utils [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:18:17 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating existing volume attachment record: 3ab135c1-673e-4cb1-ac5d-762283b87cb1 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:18:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:21 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:26 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBhJKuwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:18:28 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:18:28 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:18:28 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d2cb53-a975-480f-9a7b-424e7146476c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:18:28 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7ff99a-9a62-499a-81be-5011c655d9a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd] added
Aug 27 04:18:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b92622-c038-405c-8870-f1e46caae660]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abdecc3-a721-4adb-8d56-75ec07fdc496]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBhJKuwV {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBhJKuwV" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca8a50f-1bdc-41d9-97f9-924ce02bef19]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gBhJKuwV'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c199a842-a3fa-4a63-ad97-bb268ef87123]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfde2f92-b9d6-4912-a9e0-e2a89661b3d1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:18:28 user nova-compute[72990]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea (non-flash)
Aug 27 04:18:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:18:28 user nova-compute[72990]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea (non-flash)
Aug 27 04:18:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[c395f738-5529-4c30-889f-82cc0f8c626d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd, portal: 172.16.0.220,3260]
Aug 27 04:18:28 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd, portal: 172.16.0.220,3260] successful.
Aug 27 04:18:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[060d8324-41f7-49bb-8447-b357e411153e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[417f750a-0f63-410d-a1ed-b321d9f8451e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:18:28 user nova-compute[72990]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea (non-flash)
Aug 27 04:18:28 user nova-compute[72990]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd (non-flash)
Aug 27 04:18:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:18:28 user nova-compute[72990]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea (non-flash)
Aug 27 04:18:28 user nova-compute[72990]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd (non-flash)
Aug 27 04:18:28 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[203b98bc-816a-469c-985c-55ae6916db73]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:18:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:29 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:18:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBhJKuwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:18:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:18:29 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23062613665643135', 'path': '/dev/sdd'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:18:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062613665643135', 'path': '/dev/sdd'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:18:29 user nova-compute[72990]: DEBUG nova.objects.instance [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'flavor' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:18:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:18:29 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:18:29 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 04:18:29 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:18:29 user nova-compute[72990]:   <serial>2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd</serial>
Aug 27 04:18:29 user nova-compute[72990]: </disk>
Aug 27 04:18:29 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:18:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:18:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:18:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No VIF found with MAC fa:16:3e:bc:5e:b3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:18:29 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-fecc3411-a87e-4482-be9b-7664b54e3b55 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.945s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:18:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-90b68d1d-f091-4a32-aece-a9b08feef9b3 req-d886b205-80ae-4e19-bff3-5a87232a79d2 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Received event network-changed-f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:18:30 user nova-compute[72990]: DEBUG nova.compute.manager [req-90b68d1d-f091-4a32-aece-a9b08feef9b3 req-d886b205-80ae-4e19-bff3-5a87232a79d2 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Refreshing instance network info cache due to event network-changed-f7401d0a-fae9-41c3-acf8-b572e611688a. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:18:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-90b68d1d-f091-4a32-aece-a9b08feef9b3 req-d886b205-80ae-4e19-bff3-5a87232a79d2 service nova] Acquiring lock "refresh_cache-6210037b-bf64-40f8-a11e-df0eca4a432c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:18:30 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-90b68d1d-f091-4a32-aece-a9b08feef9b3 req-d886b205-80ae-4e19-bff3-5a87232a79d2 service nova] Acquired lock "refresh_cache-6210037b-bf64-40f8-a11e-df0eca4a432c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:18:30 user nova-compute[72990]: DEBUG nova.network.neutron [req-90b68d1d-f091-4a32-aece-a9b08feef9b3 req-d886b205-80ae-4e19-bff3-5a87232a79d2 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Refreshing network info cache for port f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:18:31 user nova-compute[72990]: DEBUG nova.network.neutron [req-90b68d1d-f091-4a32-aece-a9b08feef9b3 req-d886b205-80ae-4e19-bff3-5a87232a79d2 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Updated VIF entry in instance network info cache for port f7401d0a-fae9-41c3-acf8-b572e611688a. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:18:31 user nova-compute[72990]: DEBUG nova.network.neutron [req-90b68d1d-f091-4a32-aece-a9b08feef9b3 req-d886b205-80ae-4e19-bff3-5a87232a79d2 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Updating instance_info_cache with network_info: [{"id": "f7401d0a-fae9-41c3-acf8-b572e611688a", "address": "fa:16:3e:aa:5c:14", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7401d0a-fa", "ovs_interfaceid": "f7401d0a-fae9-41c3-acf8-b572e611688a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:18:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-90b68d1d-f091-4a32-aece-a9b08feef9b3 req-d886b205-80ae-4e19-bff3-5a87232a79d2 service nova] Releasing lock "refresh_cache-6210037b-bf64-40f8-a11e-df0eca4a432c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:18:31 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "6210037b-bf64-40f8-a11e-df0eca4a432c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:18:32 user nova-compute[72990]: INFO nova.compute.manager [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Terminating instance
Aug 27 04:18:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-ebc9d05e-3138-434c-abb2-6447c3cc26d0 req-83ea7a1c-d85e-43dd-9aa6-8443873b1559 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Received event network-vif-unplugged-f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ebc9d05e-3138-434c-abb2-6447c3cc26d0 req-83ea7a1c-d85e-43dd-9aa6-8443873b1559 service nova] Acquiring lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ebc9d05e-3138-434c-abb2-6447c3cc26d0 req-83ea7a1c-d85e-43dd-9aa6-8443873b1559 service nova] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-ebc9d05e-3138-434c-abb2-6447c3cc26d0 req-83ea7a1c-d85e-43dd-9aa6-8443873b1559 service nova] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-ebc9d05e-3138-434c-abb2-6447c3cc26d0 req-83ea7a1c-d85e-43dd-9aa6-8443873b1559 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] No waiting events found dispatching network-vif-unplugged-f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-ebc9d05e-3138-434c-abb2-6447c3cc26d0 req-83ea7a1c-d85e-43dd-9aa6-8443873b1559 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Received event network-vif-unplugged-f7401d0a-fae9-41c3-acf8-b572e611688a for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-baa3cf25-d3c6-48d7-b9b1-8906878b9adc req-53d3908d-8b5c-45c7-848a-1b240ea5e1b0 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Received event network-changed-f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG nova.compute.manager [req-baa3cf25-d3c6-48d7-b9b1-8906878b9adc req-53d3908d-8b5c-45c7-848a-1b240ea5e1b0 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Refreshing instance network info cache due to event network-changed-f7401d0a-fae9-41c3-acf8-b572e611688a. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-baa3cf25-d3c6-48d7-b9b1-8906878b9adc req-53d3908d-8b5c-45c7-848a-1b240ea5e1b0 service nova] Acquiring lock "refresh_cache-6210037b-bf64-40f8-a11e-df0eca4a432c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-baa3cf25-d3c6-48d7-b9b1-8906878b9adc req-53d3908d-8b5c-45c7-848a-1b240ea5e1b0 service nova] Acquired lock "refresh_cache-6210037b-bf64-40f8-a11e-df0eca4a432c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:18:32 user nova-compute[72990]: DEBUG nova.network.neutron [req-baa3cf25-d3c6-48d7-b9b1-8906878b9adc req-53d3908d-8b5c-45c7-848a-1b240ea5e1b0 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Refreshing network info cache for port f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:33 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Instance destroyed successfully.
Aug 27 04:18:33 user nova-compute[72990]: DEBUG nova.objects.instance [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lazy-loading 'resources' on Instance uuid 6210037b-bf64-40f8-a11e-df0eca4a432c {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:16:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1775112625',display_name='tempest-TestVolumeBootPattern-server-1775112625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1775112625',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAxiq8nzDuLrhlX90KCpMhjjdu00EEsfsUBjmDNf2QVNBgoIetJr5kJSGJfbGHc1lKfJ77a4En5IQ+5dvysFKDT9aLp7EGC0j0/Z1Ri5VH2ji/z9XR9yuImUkcGl95llA==',key_name='tempest-TestVolumeBootPattern-1921423690',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:16:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-phukgx84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:16:55Z,user_data=None,user_id='cf3112e616344af7873a50d134260637',uuid=6210037b-bf64-40f8-a11e-df0eca4a432c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7401d0a-fae9-41c3-acf8-b572e611688a", "address": "fa:16:3e:aa:5c:14", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7401d0a-fa", "ovs_interfaceid": "f7401d0a-fae9-41c3-acf8-b572e611688a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "f7401d0a-fae9-41c3-acf8-b572e611688a", "address": "fa:16:3e:aa:5c:14", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7401d0a-fa", "ovs_interfaceid": "f7401d0a-fae9-41c3-acf8-b572e611688a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:5c:14,bridge_name='br-int',has_traffic_filtering=True,id=f7401d0a-fae9-41c3-acf8-b572e611688a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7401d0a-fa') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_vif [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:5c:14,bridge_name='br-int',has_traffic_filtering=True,id=f7401d0a-fae9-41c3-acf8-b572e611688a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7401d0a-fa') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7401d0a-fa, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:18:33 user nova-compute[72990]: INFO os_vif [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:5c:14,bridge_name='br-int',has_traffic_filtering=True,id=f7401d0a-fae9-41c3-acf8-b572e611688a,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7401d0a-fa')
Aug 27 04:18:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtgDPQbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:18:33 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a423a871-a5ce-45c5-b235-8625071e2387]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[476ad63e-7866-491c-acb8-b3f2f13bceb2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:18:33 user nova-compute[72990]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea (non-flash)
Aug 27 04:18:33 user nova-compute[72990]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd (non-flash)
Aug 27 04:18:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:18:33 user nova-compute[72990]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea (non-flash)
Aug 27 04:18:33 user nova-compute[72990]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd (non-flash)
Aug 27 04:18:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa718422d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9582ba-92d0-4590-a3ea-2b4cde96fbd9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[72980359-ba05-44c9-b7af-1bd76e116856]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25ed659-ddcf-450d-b283-b8d2023f1d41]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee64a34-fdce-4a73-9985-d9e84803e395]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23165326530356563', '/dev/disk/by-id/scsi-1SCST_BIOdea17f13-1e2e05ec7433eefa', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_dea17f13') {{(pid=84652) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1661aa99-e73f-43f7-b3e6-e0f9ff12f15f]: (4, None) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb94136c-95f4-4ddd-82e4-9d692f06c486]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[240336a2-fd3e-486c-a7b1-8fa091259edd]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea, portal: 172.16.0.220,3260]
Aug 27 04:18:33 user nova-compute[72990]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea, portal: 172.16.0.220,3260] successful.
Aug 27 04:18:33 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-baa3cf25-d3c6-48d7-b9b1-8906878b9adc req-53d3908d-8b5c-45c7-848a-1b240ea5e1b0 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Updated VIF entry in instance network info cache for port f7401d0a-fae9-41c3-acf8-b572e611688a. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG nova.network.neutron [req-baa3cf25-d3c6-48d7-b9b1-8906878b9adc req-53d3908d-8b5c-45c7-848a-1b240ea5e1b0 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Updating instance_info_cache with network_info: [{"id": "f7401d0a-fae9-41c3-acf8-b572e611688a", "address": "fa:16:3e:aa:5c:14", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7401d0a-fa", "ovs_interfaceid": "f7401d0a-fae9-41c3-acf8-b572e611688a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-baa3cf25-d3c6-48d7-b9b1-8906878b9adc req-53d3908d-8b5c-45c7-848a-1b240ea5e1b0 service nova] Releasing lock "refresh_cache-6210037b-bf64-40f8-a11e-df0eca4a432c" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b512e6-db40-4aab-bb5e-9af7978de4ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c5233b-9aef-44c3-8f0c-4ad4e4a91eaa]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== disconnect_volume: return (290ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:18:33 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Deleting instance files /opt/stack/data/nova/instances/6210037b-bf64-40f8-a11e-df0eca4a432c_del
Aug 27 04:18:33 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Deletion of /opt/stack/data/nova/instances/6210037b-bf64-40f8-a11e-df0eca4a432c_del complete
Aug 27 04:18:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:33 user nova-compute[72990]: INFO nova.compute.manager [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 27 04:18:33 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:18:33 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:18:34 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Took 0.53 seconds to deallocate network for instance.
Aug 27 04:18:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-7a1b8434-9b6e-49b2-a3d7-8b4e5b490453 req-bc626553-f645-414d-ac39-2cb23ab423c4 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Received event network-vif-plugged-f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:18:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7a1b8434-9b6e-49b2-a3d7-8b4e5b490453 req-bc626553-f645-414d-ac39-2cb23ab423c4 service nova] Acquiring lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:18:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7a1b8434-9b6e-49b2-a3d7-8b4e5b490453 req-bc626553-f645-414d-ac39-2cb23ab423c4 service nova] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:18:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-7a1b8434-9b6e-49b2-a3d7-8b4e5b490453 req-bc626553-f645-414d-ac39-2cb23ab423c4 service nova] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:18:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-7a1b8434-9b6e-49b2-a3d7-8b4e5b490453 req-bc626553-f645-414d-ac39-2cb23ab423c4 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] No waiting events found dispatching network-vif-plugged-f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:18:34 user nova-compute[72990]: WARNING nova.compute.manager [req-7a1b8434-9b6e-49b2-a3d7-8b4e5b490453 req-bc626553-f645-414d-ac39-2cb23ab423c4 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Received unexpected event network-vif-plugged-f7401d0a-fae9-41c3-acf8-b572e611688a for instance with vm_state active and task_state deleting.
Aug 27 04:18:34 user nova-compute[72990]: DEBUG nova.compute.manager [req-7a1b8434-9b6e-49b2-a3d7-8b4e5b490453 req-bc626553-f645-414d-ac39-2cb23ab423c4 service nova] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Received event network-vif-deleted-f7401d0a-fae9-41c3-acf8-b572e611688a {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:18:34 user nova-compute[72990]: INFO nova.compute.manager [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Took 0.87 seconds to detach 1 volumes for instance.
Aug 27 04:18:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:18:34 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:18:35 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:18:35 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:18:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:18:35 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Deleted allocations for instance 6210037b-bf64-40f8-a11e-df0eca4a432c
Aug 27 04:18:35 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-7a49b928-1dcf-42ec-8cc8-b67c5ebbf5ba tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "6210037b-bf64-40f8-a11e-df0eca4a432c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.925s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:18:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:18:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:18:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:18:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:18:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:48 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109913.0741656, 6210037b-bf64-40f8-a11e-df0eca4a432c => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:18:48 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] VM Stopped (Lifecycle Event)
Aug 27 04:18:48 user nova-compute[72990]: DEBUG nova.compute.manager [None req-91e26043-cd87-426d-b3a9-ed0f71aaabf7 None None] [instance: 6210037b-bf64-40f8-a11e-df0eca4a432c] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:18:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:49 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:18:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:18:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:18:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:18:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:18:56 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:18:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:18:59 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:18:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:18:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:18:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:18:59 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:18:59 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:18:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:18:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:18:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:00 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72990) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 04:19:00 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:19:00 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:19:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8679MB free_disk=25.100189208984375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:19:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:19:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:19:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance c891ea66-5861-4d50-b4e1-0c20ae481fdc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:19:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 3a714f8e-55be-4b7b-9ba6-18f7559575be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:19:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:19:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:19:00 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:19:00 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:19:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:19:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:19:01 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:19:01 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:19:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:19:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:19:02 user nova-compute[72990]: INFO nova.compute.manager [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Detaching volume 2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd
Aug 27 04:19:02 user nova-compute[72990]: INFO nova.virt.block_device [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attempting to driver detach volume 2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd from mountpoint /dev/vdb
Aug 27 04:19:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Attempting to detach device vdb from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:19:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:19:02 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:19:02 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 04:19:02 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:19:02 user nova-compute[72990]:   <serial>2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd</serial>
Aug 27 04:19:02 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:19:02 user nova-compute[72990]: </disk>
Aug 27 04:19:02 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:19:02 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Successfully detached device vdb from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the persistent domain config.
Aug 27 04:19:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:19:02 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:19:02 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:19:02 user nova-compute[72990]:   <source dev="/dev/sdd"/>
Aug 27 04:19:02 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:19:02 user nova-compute[72990]:   <serial>2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd</serial>
Aug 27 04:19:02 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:19:02 user nova-compute[72990]: </disk>
Aug 27 04:19:02 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:19:02 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:19:02 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:19:02 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Didn't find any instances for network info cache update. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693109943.0464873, 3a714f8e-55be-4b7b-9ba6-18f7559575be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:19:03 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Successfully detached device vdb from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the live domain config.
Aug 27 04:19:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBhJKuwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:19:03 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63b6d1a-b2dd-4ef1-85c3-71742f383ca6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaa39ee-75b0-42c4-9ab6-4f9477a5de55]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:19:03 user nova-compute[72990]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd (non-flash)
Aug 27 04:19:03 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:19:03 user nova-compute[72990]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd (non-flash)
Aug 27 04:19:03 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f44dce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd'): ({'sdd'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Removing single pathed devices sdd {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[278c0e1b-8783-4a15-9ed5-b002cc07e713]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d408fa-43ae-4c0a-9ea7-272a3721125b]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Flushing IO for device /dev/sdd {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[061e7004-647b-47f8-830a-f549d6a72dff]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67d515b-c418-4434-bab7-9e0c73ba1eef]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] SCSI volumes sdd have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb7f037-234a-4af3-bae2-224d484e68da]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aeb9ee-795e-4ab4-ad26-eb126db42551]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd, portal: 172.16.0.220,3260]
Aug 27 04:19:03 user nova-compute[72990]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd, portal: 172.16.0.220,3260] successful.
Aug 27 04:19:03 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2014d5ca-c41f-4dd7-a51d-bbc6da94e9fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef25cb8-5d3f-48c0-bae4-2f8ce44cda24]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] <== disconnect_volume: return (298ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:19:03 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:19:04 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'flavor' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:19:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9a6a146a-cff5-44d5-8577-8b63f9750173 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.649s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:19:04 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:19:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:08 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:19:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:19:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:19:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:19:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:19:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:19:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:19:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:19:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:19:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:19:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:19:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:36 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-0fcff0d5-a698-40a2-91b2-8c0cd624111f req-2716eab8-f578-4a64-952e-dad90907f7d9 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Received event network-changed-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-0fcff0d5-a698-40a2-91b2-8c0cd624111f req-2716eab8-f578-4a64-952e-dad90907f7d9 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Refreshing instance network info cache due to event network-changed-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296. {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0fcff0d5-a698-40a2-91b2-8c0cd624111f req-2716eab8-f578-4a64-952e-dad90907f7d9 service nova] Acquiring lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0fcff0d5-a698-40a2-91b2-8c0cd624111f req-2716eab8-f578-4a64-952e-dad90907f7d9 service nova] Acquired lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG nova.network.neutron [req-0fcff0d5-a698-40a2-91b2-8c0cd624111f req-2716eab8-f578-4a64-952e-dad90907f7d9 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Refreshing network info cache for port 77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:19:37 user nova-compute[72990]: INFO nova.compute.manager [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Terminating instance
Aug 27 04:19:37 user nova-compute[72990]: DEBUG nova.compute.manager [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-aa06c7c5-d320-40f1-9986-b7985363b03b req-a4db4cfc-d204-4758-9606-d1c3a1af5e52 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Received event network-vif-unplugged-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aa06c7c5-d320-40f1-9986-b7985363b03b req-a4db4cfc-d204-4758-9606-d1c3a1af5e52 service nova] Acquiring lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aa06c7c5-d320-40f1-9986-b7985363b03b req-a4db4cfc-d204-4758-9606-d1c3a1af5e52 service nova] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-aa06c7c5-d320-40f1-9986-b7985363b03b req-a4db4cfc-d204-4758-9606-d1c3a1af5e52 service nova] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-aa06c7c5-d320-40f1-9986-b7985363b03b req-a4db4cfc-d204-4758-9606-d1c3a1af5e52 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] No waiting events found dispatching network-vif-unplugged-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG nova.compute.manager [req-aa06c7c5-d320-40f1-9986-b7985363b03b req-a4db4cfc-d204-4758-9606-d1c3a1af5e52 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Received event network-vif-unplugged-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG nova.network.neutron [req-0fcff0d5-a698-40a2-91b2-8c0cd624111f req-2716eab8-f578-4a64-952e-dad90907f7d9 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updated VIF entry in instance network info cache for port 77e9607a-ea35-4a9e-8d62-9cb9ae9ee296. {{(pid=72990) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG nova.network.neutron [req-0fcff0d5-a698-40a2-91b2-8c0cd624111f req-2716eab8-f578-4a64-952e-dad90907f7d9 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updating instance_info_cache with network_info: [{"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:19:37 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0fcff0d5-a698-40a2-91b2-8c0cd624111f req-2716eab8-f578-4a64-952e-dad90907f7d9 service nova] Releasing lock "refresh_cache-c891ea66-5861-4d50-b4e1-0c20ae481fdc" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:19:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Instance destroyed successfully.
Aug 27 04:19:38 user nova-compute[72990]: DEBUG nova.objects.instance [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lazy-loading 'resources' on Instance uuid c891ea66-5861-4d50-b4e1-0c20ae481fdc {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:14:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1856381000',display_name='tempest-TestVolumeBootPattern-server-1856381000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1856381000',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAxiq8nzDuLrhlX90KCpMhjjdu00EEsfsUBjmDNf2QVNBgoIetJr5kJSGJfbGHc1lKfJ77a4En5IQ+5dvysFKDT9aLp7EGC0j0/Z1Ri5VH2ji/z9XR9yuImUkcGl95llA==',key_name='tempest-TestVolumeBootPattern-1921423690',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:14:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d6b19a372f947e4aee43f9d7573e8f7',ramdisk_id='',reservation_id='r-d19rghq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1834919775',owner_user_name='tempest-TestVolumeBootPattern-1834919775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:14:56Z,user_data=None,user_id='cf3112e616344af7873a50d134260637',uuid=c891ea66-5861-4d50-b4e1-0c20ae481fdc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converting VIF {"id": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "address": "fa:16:3e:16:ae:aa", "network": {"id": "3cad785d-8bbf-42e4-9ce5-8d1dfca7109d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1594026217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6b19a372f947e4aee43f9d7573e8f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e9607a-ea", "ovs_interfaceid": "77e9607a-ea35-4a9e-8d62-9cb9ae9ee296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:ae:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e9607a-ea35-4a9e-8d62-9cb9ae9ee296,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e9607a-ea') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_vif [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:ae:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e9607a-ea35-4a9e-8d62-9cb9ae9ee296,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e9607a-ea') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77e9607a-ea, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:19:38 user nova-compute[72990]: INFO os_vif [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:ae:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e9607a-ea35-4a9e-8d62-9cb9ae9ee296,network=Network(3cad785d-8bbf-42e4-9ce5-8d1dfca7109d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e9607a-ea')
Aug 27 04:19:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhJcfbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:19:38 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[da00612d-9615-40b5-aff8-457959e3f78a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6530179b-4407-4034-8421-bf62929ed934]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:19:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd (non-flash)
Aug 27 04:19:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7236feb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd'): ({'sdc'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Removing single pathed devices sdc {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bed7c84-dd3f-4541-9dee-8ab011c1eba7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5619d588-e964-4921-87fa-40b22f4be011]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Flushing IO for device /dev/sdc {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9254c741-35a7-4b71-ae53-616c7d74a09f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b6d04c-0b89-44d1-9594-b5f8a0743e2e]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] SCSI volumes sdc have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23761623534346337', '/dev/disk/by-id/scsi-1SCST_BIO857a19f4-7ab544c719ab4560', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_857a19f4') {{(pid=84652) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ff5fee-5302-4f15-a247-40f01371b26e]: (4, None) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[958425a0-7c55-4c8c-a86b-5a2e747f4d06]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2ac64a-995e-47d6-87c0-36a4d4ab7a1a]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260]
Aug 27 04:19:38 user nova-compute[72990]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd, portal: 172.16.0.220,3260] successful.
Aug 27 04:19:38 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23922e53-afbc-46e7-bf42-af1a78569fbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1893572-14db-4c7d-b4cb-3c9d82ab092f]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] <== disconnect_volume: return (280ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:19:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Deleting instance files /opt/stack/data/nova/instances/c891ea66-5861-4d50-b4e1-0c20ae481fdc_del
Aug 27 04:19:38 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Deletion of /opt/stack/data/nova/instances/c891ea66-5861-4d50-b4e1-0c20ae481fdc_del complete
Aug 27 04:19:38 user nova-compute[72990]: INFO nova.compute.manager [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 27 04:19:38 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:19:38 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:19:39 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:19:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-7c2be4f1-68d2-46a7-9268-865403dd3194 req-f79d200e-4336-4783-9c0d-27fba82b77d1 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Received event network-vif-deleted-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:19:39 user nova-compute[72990]: INFO nova.compute.manager [req-7c2be4f1-68d2-46a7-9268-865403dd3194 req-f79d200e-4336-4783-9c0d-27fba82b77d1 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Neutron deleted interface 77e9607a-ea35-4a9e-8d62-9cb9ae9ee296; detaching it from the instance and deleting it from the info cache
Aug 27 04:19:39 user nova-compute[72990]: DEBUG nova.network.neutron [req-7c2be4f1-68d2-46a7-9268-865403dd3194 req-f79d200e-4336-4783-9c0d-27fba82b77d1 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:19:39 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Took 0.57 seconds to deallocate network for instance.
Aug 27 04:19:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-7c2be4f1-68d2-46a7-9268-865403dd3194 req-f79d200e-4336-4783-9c0d-27fba82b77d1 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Detach interface failed, port_id=77e9607a-ea35-4a9e-8d62-9cb9ae9ee296, reason: Instance c891ea66-5861-4d50-b4e1-0c20ae481fdc could not be found. {{(pid=72990) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 04:19:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-fab80e4a-a695-4b5d-a3d8-5ae9faf005de req-d37ed34f-127e-46c3-8b36-dd535f42db56 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Received event network-vif-plugged-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:19:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fab80e4a-a695-4b5d-a3d8-5ae9faf005de req-d37ed34f-127e-46c3-8b36-dd535f42db56 service nova] Acquiring lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:19:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fab80e4a-a695-4b5d-a3d8-5ae9faf005de req-d37ed34f-127e-46c3-8b36-dd535f42db56 service nova] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:19:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-fab80e4a-a695-4b5d-a3d8-5ae9faf005de req-d37ed34f-127e-46c3-8b36-dd535f42db56 service nova] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:19:39 user nova-compute[72990]: DEBUG nova.compute.manager [req-fab80e4a-a695-4b5d-a3d8-5ae9faf005de req-d37ed34f-127e-46c3-8b36-dd535f42db56 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] No waiting events found dispatching network-vif-plugged-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:19:39 user nova-compute[72990]: WARNING nova.compute.manager [req-fab80e4a-a695-4b5d-a3d8-5ae9faf005de req-d37ed34f-127e-46c3-8b36-dd535f42db56 service nova] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Received unexpected event network-vif-plugged-77e9607a-ea35-4a9e-8d62-9cb9ae9ee296 for instance with vm_state active and task_state deleting.
Aug 27 04:19:39 user nova-compute[72990]: INFO nova.compute.manager [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Took 0.79 seconds to detach 1 volumes for instance.
Aug 27 04:19:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:19:39 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:19:39 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:19:39 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:19:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:19:40 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Deleted allocations for instance c891ea66-5861-4d50-b4e1-0c20ae481fdc
Aug 27 04:19:40 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-44cb217e-233b-4020-8be2-0a3fe51cd174 tempest-TestVolumeBootPattern-1834919775 tempest-TestVolumeBootPattern-1834919775-project-member] Lock "c891ea66-5861-4d50-b4e1-0c20ae481fdc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.832s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:19:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:19:50 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:19:53 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693109978.0689986, c891ea66-5861-4d50-b4e1-0c20ae481fdc => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:19:53 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] VM Stopped (Lifecycle Event)
Aug 27 04:19:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:19:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-f30966a0-7aac-42f0-9daa-cb2c563f6317 None None] [instance: c891ea66-5861-4d50-b4e1-0c20ae481fdc] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:19:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:19:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:19:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'flavor' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:19:56 user nova-compute[72990]: INFO nova.compute.manager [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attaching volume ad3514e9-2ccf-45a3-a825-22c29d9589e8 to /dev/vdb
Aug 27 04:19:56 user nova-compute[72990]: DEBUG os_brick.utils [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[778bba4a-4674-49a3-b6d8-3f24f8cb698a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30061f6-e76a-484b-ba94-9f45440c4fa9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caace1d-057f-49dd-9953-937557425abd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[323cde00-4f71-4e44-a25e-dedb1a70e9c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:19:56 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:19:56 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f45935-f7d2-407e-b522-53522aee1edb]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG os_brick.utils [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:19:56 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating existing volume attachment record: 23b923cb-ab5d-4c2e-9f3e-950292e74056 {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:19:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:19:58 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:19:59 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:19:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:19:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:19:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:19:59 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:19:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:19:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:19:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:00 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:20:00 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:20:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8744MB free_disk=25.098953247070312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:20:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:20:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:20:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 3a714f8e-55be-4b7b-9ba6-18f7559575be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:20:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:20:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:20:00 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:20:00 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:20:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:20:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:20:01 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:20:01 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:20:02 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:20:02 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:20:02 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:20:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:20:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:20:02 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:20:02 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:20:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:03 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating instance_info_cache with network_info: [{"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:20:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:20:03 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:20:04 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enTXESzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:20:07 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:20:07 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:20:07 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd3a72f-3cac-4e10-b6b1-e9fcb46b2aad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:20:07 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e375a62-9dd7-4ec4-8323-8e75d2eb1888]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8] added
Aug 27 04:20:07 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadd5c0b-f577-4379-83fa-66ab431d63c2]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[641d76bf-9d65-4f44-9a9f-a4949a9000d8]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v enTXESzR {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v enTXESzR" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be18a3a-7dcc-4b7b-8788-da9a5027e76d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'enTXESzR'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d7833c-1257-4c1f-a034-7603e9bc7847]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7c025c-4b81-4ce8-8166-6d08e51ae71f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 04:20:07 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 04:20:07 user nova-compute[72990]:  {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:20:07 user nova-compute[72990]: WARNING os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 04:20:07 user nova-compute[72990]: 
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a7a9ee-5b41-464e-845b-f2027225ed5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8, portal: 172.16.0.220,3260]
Aug 27 04:20:07 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8, portal: 172.16.0.220,3260] successful.
Aug 27 04:20:07 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c38b8a8-be46-434b-8f4f-7e3e177ca4cc]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[435f0292-1fb0-4ca2-bcbc-6d46c7822ffe]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 (non-flash)
Aug 27 04:20:07 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 (non-flash)
Aug 27 04:20:07 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a58e9a-38d1-4442-9583-120b2d5cdd75]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:07 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:20:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:08 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:20:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enTXESzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:20:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.263s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:20:08 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] <== connect_volume: return (1265ms) {'type': 'block', 'scsi_wwn': '23733613434393338', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:20:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733613434393338', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:20:08 user nova-compute[72990]: DEBUG nova.objects.instance [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'flavor' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:20:08 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:20:08 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:20:08 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:20:08 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:20:08 user nova-compute[72990]:   <serial>ad3514e9-2ccf-45a3-a825-22c29d9589e8</serial>
Aug 27 04:20:08 user nova-compute[72990]: </disk>
Aug 27 04:20:08 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:20:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:20:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:20:09 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No VIF found with MAC fa:16:3e:bc:5e:b3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:20:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-9c65d7a1-c2c1-440f-a50d-653096a2cdbe tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.701s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:20:11 user nova-compute[72990]: INFO nova.compute.manager [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Detaching volume ad3514e9-2ccf-45a3-a825-22c29d9589e8
Aug 27 04:20:11 user nova-compute[72990]: INFO nova.virt.block_device [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attempting to driver detach volume ad3514e9-2ccf-45a3-a825-22c29d9589e8 from mountpoint /dev/vdb
Aug 27 04:20:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Attempting to detach device vdb from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:20:11 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:20:11 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:20:11 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:20:11 user nova-compute[72990]:   <serial>ad3514e9-2ccf-45a3-a825-22c29d9589e8</serial>
Aug 27 04:20:11 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:20:11 user nova-compute[72990]: </disk>
Aug 27 04:20:11 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:20:11 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Successfully detached device vdb from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the persistent domain config.
Aug 27 04:20:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:20:11 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:20:11 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:20:11 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:20:11 user nova-compute[72990]:   <serial>ad3514e9-2ccf-45a3-a825-22c29d9589e8</serial>
Aug 27 04:20:11 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:20:11 user nova-compute[72990]: </disk>
Aug 27 04:20:11 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693110011.6451886, 3a714f8e-55be-4b7b-9ba6-18f7559575be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:20:11 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Successfully detached device vdb from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the live domain config.
Aug 27 04:20:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enTXESzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:20:11 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[af137538-f0de-4d53-9c6e-2bc8cedde0ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41786ad-6e2c-43ac-8407-cfd06fe1a338]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 (non-flash)
Aug 27 04:20:11 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 (non-flash)
Aug 27 04:20:11 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f4172cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f261c896-fcec-4205-9520-03f6cbd98192]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfe01e5-99b3-4744-bb04-8e954e63cc64]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1b777e-2690-40c0-87ba-a10a9f110e34]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4923bc72-c7fd-4230-8882-b3a233b20256]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[46500bb2-03cf-47b9-ab83-411b57f70a34]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ea647f-0886-42aa-8cb3-909b7fbfc6cb]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8, portal: 172.16.0.220,3260]
Aug 27 04:20:11 user nova-compute[72990]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8, portal: 172.16.0.220,3260] successful.
Aug 27 04:20:11 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3514e9-2ccf-45a3-a825-22c29d9589e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0db2a4-7cc4-4bc1-9a2f-81b891b97e34]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] <== disconnect_volume: return (280ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:20:11 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:20:12 user nova-compute[72990]: DEBUG nova.objects.instance [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'flavor' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:20:12 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-a8a451fd-1c4d-45ec-8025-55e8bbd0855b tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.626s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:20:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:20:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:20:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:20:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:20:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:20:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:20:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:20:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:20:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:20:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:20:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:42 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:20:50 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:20:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:20:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:20:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:20:55 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:20:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:20:59 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:20:59 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:20:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:20:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:20:59 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:20:59 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:20:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:20:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:20:59 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:00 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:21:00 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:21:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=25.09732437133789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:21:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:21:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:21:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 3a714f8e-55be-4b7b-9ba6-18f7559575be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:21:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:21:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:21:00 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:21:00 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:21:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:21:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:21:02 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:21:02 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:21:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:21:03 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:21:03 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:21:03 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:21:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:21:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:21:03 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:21:03 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:21:04 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating instance_info_cache with network_info: [{"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:21:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:21:04 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:21:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:21:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:21:05 user nova-compute[72990]: DEBUG nova.objects.instance [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'flavor' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:21:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:21:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:21:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:21:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:21:05 user nova-compute[72990]: INFO nova.compute.manager [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attaching volume cdec076c-796c-43bb-8b01-f32fa34af96d to /dev/vdb
Aug 27 04:21:05 user nova-compute[72990]: DEBUG os_brick.utils [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:21:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:05 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a6a6fa-25e9-4f75-b199-22c36a0f8b3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc611a0-210a-4597-8f9d-e48df231f0cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec1d2f3-3659-4d53-b363-db68b33e7854]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82f5cd7-92f7-49b8-91bc-0224f8808d56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:21:06 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:21:06 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1255e7-b3de-4e70-aa2c-3465a3dfb3ae]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG os_brick.utils [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:21:06 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating existing volume attachment record: e951015f-4bf9-4ba9-9361-768552a55b2a {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:21:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:21:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:21:12 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:21:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChnOyYxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:21:16 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:21:16 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:21:16 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac28a12-80e7-4e52-9c4c-88e6d5472382]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:21:16 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[576e90dd-f92f-4634-8546-03e26e7836d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d] added
Aug 27 04:21:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4b7472-6261-4755-adbc-31de2338c985]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[98625c11-de8c-4dbb-af10-6e0ba0ab3731]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChnOyYxD {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChnOyYxD" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb15d895-3dcb-4a60-b8e7-02cc9bd43132]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ChnOyYxD'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5bc040-a059-46ae-9f2b-43cfc850456b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[2678fb0d-efa3-4661-86d1-fe2f30316c1b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 04:21:16 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 04:21:16 user nova-compute[72990]:  {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:21:16 user nova-compute[72990]: WARNING os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 04:21:16 user nova-compute[72990]: 
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[4871b39b-ee95-49c6-988d-ec9eabb9bfa5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d, portal: 172.16.0.220,3260]
Aug 27 04:21:16 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d, portal: 172.16.0.220,3260] successful.
Aug 27 04:21:16 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e19b2c6-b890-4bf2-9a51-bd56b9ffc8d1]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:21:16 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a1151-8958-4b04-a511-6b431617acb6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d (non-flash)
Aug 27 04:21:17 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d (non-flash)
Aug 27 04:21:17 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f87c35-a28f-40f6-8070-2df98ce63fb6]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:21:17 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChnOyYxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:21:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:21:18 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23135393965326565', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:21:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135393965326565', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:21:18 user nova-compute[72990]: DEBUG nova.objects.instance [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'flavor' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:21:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:21:18 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:21:18 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:21:18 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:21:18 user nova-compute[72990]:   <serial>cdec076c-796c-43bb-8b01-f32fa34af96d</serial>
Aug 27 04:21:18 user nova-compute[72990]: </disk>
Aug 27 04:21:18 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:21:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:21:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:21:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:21:18 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No VIF found with MAC fa:16:3e:bc:5e:b3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:21:18 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-b40cf1e0-56b0-47e1-82ce-171500fae2d1 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.707s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:21:21 user nova-compute[72990]: INFO nova.compute.manager [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Detaching volume cdec076c-796c-43bb-8b01-f32fa34af96d
Aug 27 04:21:21 user nova-compute[72990]: INFO nova.virt.block_device [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attempting to driver detach volume cdec076c-796c-43bb-8b01-f32fa34af96d from mountpoint /dev/vdb
Aug 27 04:21:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Attempting to detach device vdb from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:21:21 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:21:21 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:21:21 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:21:21 user nova-compute[72990]:   <serial>cdec076c-796c-43bb-8b01-f32fa34af96d</serial>
Aug 27 04:21:21 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:21:21 user nova-compute[72990]: </disk>
Aug 27 04:21:21 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:21:21 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Successfully detached device vdb from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the persistent domain config.
Aug 27 04:21:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:21:21 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:21:21 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:21:21 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:21:21 user nova-compute[72990]:   <serial>cdec076c-796c-43bb-8b01-f32fa34af96d</serial>
Aug 27 04:21:21 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:21:21 user nova-compute[72990]: </disk>
Aug 27 04:21:21 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693110081.6459787, 3a714f8e-55be-4b7b-9ba6-18f7559575be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:21:21 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Successfully detached device vdb from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the live domain config.
Aug 27 04:21:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChnOyYxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:21:21 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d8ccad-0623-4172-96b5-8be138318659]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[73551762-4f43-45ca-aeec-f48a23bf73f0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d (non-flash)
Aug 27 04:21:21 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d (non-flash)
Aug 27 04:21:21 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa6f46e9900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[11289884-a5ec-4823-bd47-74240dac5c6a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[db10583d-a9c2-4fa3-a7ef-c932244c9b79]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6657f21e-fb65-4fbc-b722-09e0ed84c72b]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[593948fe-3b84-4aa4-8dc2-86ff3b222e4c]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[def48f25-666a-443e-bcd4-fe1a70419427]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35ab3b9-41d1-4b0a-adfc-3daae29ab5d5]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d, portal: 172.16.0.220,3260]
Aug 27 04:21:21 user nova-compute[72990]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d, portal: 172.16.0.220,3260] successful.
Aug 27 04:21:21 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdec076c-796c-43bb-8b01-f32fa34af96d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aba89bc-0e49-46a8-a925-b749204d95ad]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] <== disconnect_volume: return (256ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:21:21 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:21:22 user nova-compute[72990]: DEBUG nova.objects.instance [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'flavor' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:21:22 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-2d895b3e-d9a2-45f9-9523-566bc3d56d35 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:21:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:21:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:21:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:21:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:21:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:21:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:21:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:21:52 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:21:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:21:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:21:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:21:56 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:21:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 04:21:56 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] There are 0 instances to clean {{(pid=72990) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 04:21:57 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:21:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:22:00 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:22:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:22:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:22:00 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:22:00 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:22:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:00 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:01 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:22:01 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:22:01 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8852MB free_disk=25.096302032470703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 3a714f8e-55be-4b7b-9ba6-18f7559575be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing inventories for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating ProviderTree inventory for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Updating inventory in ProviderTree for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing aggregate associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, aggregates: None {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Refreshing trait associations for resource provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI {{(pid=72990) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:22:01 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:22:02 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:22:02 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:22:02 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:22:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:22:03 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:22:03 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:22:03 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:22:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:22:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:22:03 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:22:03 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:22:04 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating instance_info_cache with network_info: [{"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:22:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:22:04 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:22:07 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:22:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:22:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:22:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:22:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:22:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:22:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:22:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG nova.objects.instance [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'flavor' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:22:15 user nova-compute[72990]: INFO nova.compute.manager [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attaching volume 20f8fc9c-348a-459f-9e59-f1f4c039d7a0 to /dev/vdb
Aug 27 04:22:15 user nova-compute[72990]: DEBUG os_brick.utils [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77e538f-c023-414e-bb96-cc500d009e51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dc5861431d9c\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[7246d61f-af55-407f-8164-81e4474c7d71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3afb8b-8432-49c8-b136-46a91d06ccc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a694ce4e-bfd4-4ab6-9a05-2623a8df86ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Running cmd (subprocess): nvme version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] 'nvme version' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] nvme not present on system {{(pid=72990) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:22:15 user nova-compute[72990]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:22:15 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[0966f5b4-f682-44c0-818c-aaef1f1bed11]: (4, '') {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72990) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.lightos [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] LIGHTOS: no hostnqn found. {{(pid=72990) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG os_brick.utils [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dc5861431d9c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:22:15 user nova-compute[72990]: DEBUG nova.virt.block_device [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating existing volume attachment record: 696fc8f1-5c90-4d12-95a6-8c7ce8f2874e {{(pid=72990) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:22:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:22:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:22:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Calling os-brick to attach iSCSI Volume {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpKsxAXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:22:26 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:22:26 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:22:26 user nova-compute[72990]: INFO os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[714dd6b2-cbaf-479b-a85f-fab44dbc4203]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 04:22:26 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[8617d674-b51d-428e-b1bb-5e7d9e990903]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0] added\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0] added
Aug 27 04:22:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dc4131-cb7c-40cc-8700-874993413200]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a93beb-03bc-4020-b636-27cd3fcbe59d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpKsxAXt {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpKsxAXt" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[44846e8f-a613-4ee5-9805-1dc54578e34d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EpKsxAXt'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[318be7fc-d58c-45a5-b896-6797e9bce48d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce0a37c-24ea-4767-a40f-81d9fd974c38]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 04:22:26 user nova-compute[72990]:  {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 04:22:26 user nova-compute[72990]:  {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:22:26 user nova-compute[72990]: WARNING os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 04:22:26 user nova-compute[72990]: 
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --login {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fbe7db-c2b1-49d8-8246-5d90d8aef658]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0, portal: 172.16.0.220,3260]
Aug 27 04:22:26 user nova-compute[72990]: Login to [iface: default, target: iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0, portal: 172.16.0.220,3260] successful.
Aug 27 04:22:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[736d034a-35c8-40c4-91ef-36ed72e89a0d]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a74b5e3-507e-4bbf-af12-1fdf4df07319]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 (non-flash)
Aug 27 04:22:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 (non-flash)
Aug 27 04:22:26 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Connected to 172.16.0.220:3260 {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72990) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72990) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[17253aa6-49e2-4c4b-9f8f-7ef15a4d1c0f]: (4, ('- - 0', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72990) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 04:22:26 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpKsxAXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72990) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 04:22:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:22:27 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23439366431373362', 'path': '/dev/sdb'} {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:22:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439366431373362', 'path': '/dev/sdb'} {{(pid=72990) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 04:22:27 user nova-compute[72990]: DEBUG nova.objects.instance [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'flavor' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:22:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 04:22:27 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:22:27 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:22:27 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:22:27 user nova-compute[72990]:   <serial>20f8fc9c-348a-459f-9e59-f1f4c039d7a0</serial>
Aug 27 04:22:27 user nova-compute[72990]: </disk>
Aug 27 04:22:27 user nova-compute[72990]:  {{(pid=72990) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 04:22:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No BDM found with device name vda, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:22:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72990) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:22:27 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] No VIF found with MAC fa:16:3e:bc:5e:b3, not building metadata {{(pid=72990) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:22:27 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-1f1de1cc-6e05-4e83-9ade-f54cc6e08f02 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.444s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:22:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:22:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:22:28 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:22:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:22:29 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:22:29 user nova-compute[72990]: INFO nova.compute.manager [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Detaching volume 20f8fc9c-348a-459f-9e59-f1f4c039d7a0
Aug 27 04:22:29 user nova-compute[72990]: INFO nova.virt.block_device [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Attempting to driver detach volume 20f8fc9c-348a-459f-9e59-f1f4c039d7a0 from mountpoint /dev/vdb
Aug 27 04:22:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Attempting to detach device vdb from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the persistent domain config. {{(pid=72990) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 04:22:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:22:29 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:22:29 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:22:29 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:22:29 user nova-compute[72990]:   <serial>20f8fc9c-348a-459f-9e59-f1f4c039d7a0</serial>
Aug 27 04:22:29 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:22:29 user nova-compute[72990]: </disk>
Aug 27 04:22:29 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:22:29 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Successfully detached device vdb from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the persistent domain config.
Aug 27 04:22:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the live domain config. {{(pid=72990) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 04:22:29 user nova-compute[72990]: DEBUG nova.virt.libvirt.guest [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 04:22:29 user nova-compute[72990]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 04:22:29 user nova-compute[72990]:   <source dev="/dev/sdb"/>
Aug 27 04:22:29 user nova-compute[72990]:   <target dev="vdb" bus="virtio"/>
Aug 27 04:22:29 user nova-compute[72990]:   <serial>20f8fc9c-348a-459f-9e59-f1f4c039d7a0</serial>
Aug 27 04:22:29 user nova-compute[72990]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 04:22:29 user nova-compute[72990]: </disk>
Aug 27 04:22:29 user nova-compute[72990]:  {{(pid=72990) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-14547c73-9aef-42a0-8acb-8504aff27ce5 None None] Received event <DeviceRemovedEvent: 1693110150.4279637, 3a714f8e-55be-4b7b-9ba6-18f7559575be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72990) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.driver [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 04:22:30 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Successfully detached device vdb from instance 3a714f8e-55be-4b7b-9ba6-18f7559575be from the live domain config.
Aug 27 04:22:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] calling os-brick to detach iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7142e4e20>, {'target_iqns': ['iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpKsxAXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:22:30 user nova-compute[72990]: WARNING os_brick.initiator.connectors.base [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0', 0)] {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[759b9fe2-ad42-4a81-85d6-c8986aefa704]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a8dda-346d-4b7a-9d96-204479b49f06]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 (non-flash)\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 (non-flash)
Aug 27 04:22:30 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 (non-flash)
Aug 27 04:22:30 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa718423490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0'): ({'sdb'}, set())}) {{(pid=72990) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Removing single pathed devices sdb {{(pid=72990) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc2d62-9419-4217-97b6-16b8dd4613ed]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[358bb0cd-d08e-4121-950e-f2a576f4f7cc]: (4, ('ok\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Flushing IO for device /dev/sdb {{(pid=72990) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b477df-a8fe-4e60-be5c-d40f7e07324e]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72990) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59bd613-a968-480b-8625-fd89e269356c]: (4, ('1', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.linuxscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] SCSI volumes sdb have been removed. {{(pid=72990) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0')] {{(pid=72990) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac432222-bb83-4707-8c8b-18f1d054b650]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --logout {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc86b288-323a-44fc-94cc-686f36ea2df9]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0, portal: 172.16.0.220,3260]
Aug 27 04:22:30 user nova-compute[72990]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0, portal: 172.16.0.220,3260] successful.
Aug 27 04:22:30 user nova-compute[72990]:  stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op delete {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f8fc9c-348a-459f-9e59-f1f4c039d7a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84652) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f43093-1e10-4744-a5c3-d3dc4643f7c3]: (4, ('', '')) {{(pid=84652) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72990) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.base [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG os_brick.initiator.connectors.iscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] <== disconnect_volume: return (259ms) None {{(pid=72990) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:22:30 user nova-compute[72990]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Disconnected iSCSI Volume {{(pid=72990) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 04:22:31 user nova-compute[72990]: DEBUG nova.objects.instance [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'flavor' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:22:31 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-88674f82-f62f-4509-bb6f-8c407c167de3 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.640s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:22:32 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:22:32 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72990) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 04:22:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:22:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:22:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:22:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:22:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:22:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:22:53 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:22:53 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:22:54 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:22:57 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:22:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:22:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:22:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:22:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:22:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:22:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:23:02 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:23:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:23:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:23:02 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:23:02 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:23:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:23:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:23:02 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:23:03 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:23:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:23:03 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:23:03 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:23:03 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=25.095325469970703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:23:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:23:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:23:03 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 3a714f8e-55be-4b7b-9ba6-18f7559575be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:23:03 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:23:03 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:23:03 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:23:03 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:23:03 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:23:03 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:23:04 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:23:04 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:23:04 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:23:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:23:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:23:04 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:23:04 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:23:05 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating instance_info_cache with network_info: [{"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:23:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:23:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:23:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:23:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:23:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:23:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:23:08 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:23:12 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:23:13 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:23:18 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:23:23 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:23:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:23:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:23:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:23:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:23:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:23:28 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:23:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:23:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:23:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:23:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:23:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:23:33 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:23:38 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:23:43 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:23:48 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:23:53 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:23:54 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:23:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:23:56 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:23:58 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:23:58 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:24:03 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:24:03 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:24:04 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:24:04 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:24:04 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:24:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:24:04 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquired lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:24:04 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Forcefully refreshing network info cache for instance {{(pid=72990) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:24:04 user nova-compute[72990]: DEBUG nova.objects.instance [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lazy-loading 'info_cache' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG nova.network.neutron [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating instance_info_cache with network_info: [{"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Releasing lock "refresh_cache-3a714f8e-55be-4b7b-9ba6-18f7559575be" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updated the network info_cache for instance {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:24:05 user nova-compute[72990]: DEBUG oslo_concurrency.processutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:24:06 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:24:06 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:24:06 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=25.094341278076172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:24:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:24:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:24:06 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Instance 3a714f8e-55be-4b7b-9ba6-18f7559575be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72990) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:24:06 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:24:06 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:24:06 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:24:06 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:24:06 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:24:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:24:08 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:24:09 user nova-compute[72990]: INFO nova.compute.manager [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Terminating instance
Aug 27 04:24:09 user nova-compute[72990]: DEBUG nova.compute.manager [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Start destroying the instance on the hypervisor. {{(pid=72990) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-0cf0d8dc-f372-43b3-bc6e-4f13b053c88e req-6eb94904-6674-435e-b15e-2d85bbd2ac4c service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Received event network-vif-unplugged-f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0cf0d8dc-f372-43b3-bc6e-4f13b053c88e req-6eb94904-6674-435e-b15e-2d85bbd2ac4c service nova] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0cf0d8dc-f372-43b3-bc6e-4f13b053c88e req-6eb94904-6674-435e-b15e-2d85bbd2ac4c service nova] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-0cf0d8dc-f372-43b3-bc6e-4f13b053c88e req-6eb94904-6674-435e-b15e-2d85bbd2ac4c service nova] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-0cf0d8dc-f372-43b3-bc6e-4f13b053c88e req-6eb94904-6674-435e-b15e-2d85bbd2ac4c service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] No waiting events found dispatching network-vif-unplugged-f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:24:09 user nova-compute[72990]: DEBUG nova.compute.manager [req-0cf0d8dc-f372-43b3-bc6e-4f13b053c88e req-6eb94904-6674-435e-b15e-2d85bbd2ac4c service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Received event network-vif-unplugged-f2dfac59-e892-409d-b01e-ee4f2c9ed397 for instance with task_state deleting. {{(pid=72990) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 04:24:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:10 user nova-compute[72990]: INFO nova.virt.libvirt.driver [-] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Instance destroyed successfully.
Aug 27 04:24:10 user nova-compute[72990]: DEBUG nova.objects.instance [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lazy-loading 'resources' on Instance uuid 3a714f8e-55be-4b7b-9ba6-18f7559575be {{(pid=72990) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:24:10 user nova-compute[72990]: DEBUG nova.virt.libvirt.vif [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1125722199',display_name='tempest-SnapshotDataIntegrityTests-server-1125722199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1125722199',id=51,image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE42KvVRD/0I0fmleXo8oBTd7kchFkxn/01OfD9x8Jo0rMAIJlANcF0uhl9uvsUWybg6GlWpkcDul9N0uLFsycGgQXQa4EDDaZ5WmQecPRjiCAzeKc0ces2cHXZT94+jJA==',key_name='tempest-keypair-551016695',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:16:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5010681c11574c4e8d64de3be1a1ebf8',ramdisk_id='',reservation_id='r-vsjkbq7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a49a9f69-b2fa-42fe-942e-afa347d26054',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1361664179',owner_user_name='tempest-SnapshotDataIntegrityTests-1361664179-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc64fe032374763981adbbe658b223b',uuid=3a714f8e-55be-4b7b-9ba6-18f7559575be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 04:24:10 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Converting VIF {"id": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "address": "fa:16:3e:bc:5e:b3", "network": {"id": "0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-998191528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5010681c11574c4e8d64de3be1a1ebf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dfac59-e8", "ovs_interfaceid": "f2dfac59-e892-409d-b01e-ee4f2c9ed397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:24:10 user nova-compute[72990]: DEBUG nova.network.os_vif_util [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:5e:b3,bridge_name='br-int',has_traffic_filtering=True,id=f2dfac59-e892-409d-b01e-ee4f2c9ed397,network=Network(0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dfac59-e8') {{(pid=72990) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:24:10 user nova-compute[72990]: DEBUG os_vif [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:5e:b3,bridge_name='br-int',has_traffic_filtering=True,id=f2dfac59-e892-409d-b01e-ee4f2c9ed397,network=Network(0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dfac59-e8') {{(pid=72990) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 04:24:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2dfac59-e8, bridge=br-int, if_exists=True) {{(pid=72990) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:24:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:24:10 user nova-compute[72990]: INFO os_vif [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:5e:b3,bridge_name='br-int',has_traffic_filtering=True,id=f2dfac59-e892-409d-b01e-ee4f2c9ed397,network=Network(0fa5c7fc-1c2f-450a-b94d-2c2b0fa2d715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dfac59-e8')
Aug 27 04:24:10 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Deleting instance files /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be_del
Aug 27 04:24:10 user nova-compute[72990]: INFO nova.virt.libvirt.driver [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Deletion of /opt/stack/data/nova/instances/3a714f8e-55be-4b7b-9ba6-18f7559575be_del complete
Aug 27 04:24:10 user nova-compute[72990]: INFO nova.compute.manager [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 27 04:24:10 user nova-compute[72990]: DEBUG oslo.service.loopingcall [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72990) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 04:24:10 user nova-compute[72990]: DEBUG nova.compute.manager [-] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Deallocating network for instance {{(pid=72990) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 04:24:10 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] deallocate_for_instance() {{(pid=72990) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 04:24:10 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:24:11 user nova-compute[72990]: DEBUG nova.network.neutron [-] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Updating instance_info_cache with network_info: [] {{(pid=72990) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:24:11 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Took 0.86 seconds to deallocate network for instance.
Aug 27 04:24:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:24:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:24:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-0e51d3ab-8d76-4a81-b57a-ee05283c3f86 req-1bae7094-75b2-4575-a850-c5987cacade0 service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Received event network-vif-deleted-f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:24:11 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:24:11 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:24:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:24:11 user nova-compute[72990]: INFO nova.scheduler.client.report [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Deleted allocations for instance 3a714f8e-55be-4b7b-9ba6-18f7559575be
Aug 27 04:24:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-e241a392-ff72-4c80-a72c-d0900372f406 tempest-SnapshotDataIntegrityTests-1361664179 tempest-SnapshotDataIntegrityTests-1361664179-project-member] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.056s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:24:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-3feef691-3984-4570-a9a8-f7a10301f882 req-86d3a652-355b-4e64-97cb-04009d7c011b service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Received event network-vif-plugged-f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:24:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3feef691-3984-4570-a9a8-f7a10301f882 req-86d3a652-355b-4e64-97cb-04009d7c011b service nova] Acquiring lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:24:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3feef691-3984-4570-a9a8-f7a10301f882 req-86d3a652-355b-4e64-97cb-04009d7c011b service nova] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:24:11 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [req-3feef691-3984-4570-a9a8-f7a10301f882 req-86d3a652-355b-4e64-97cb-04009d7c011b service nova] Lock "3a714f8e-55be-4b7b-9ba6-18f7559575be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:24:11 user nova-compute[72990]: DEBUG nova.compute.manager [req-3feef691-3984-4570-a9a8-f7a10301f882 req-86d3a652-355b-4e64-97cb-04009d7c011b service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] No waiting events found dispatching network-vif-plugged-f2dfac59-e892-409d-b01e-ee4f2c9ed397 {{(pid=72990) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:24:11 user nova-compute[72990]: WARNING nova.compute.manager [req-3feef691-3984-4570-a9a8-f7a10301f882 req-86d3a652-355b-4e64-97cb-04009d7c011b service nova] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Received unexpected event network-vif-plugged-f2dfac59-e892-409d-b01e-ee4f2c9ed397 for instance with vm_state deleted and task_state None.
Aug 27 04:24:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:24:25 user nova-compute[72990]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693110250.3228905, 3a714f8e-55be-4b7b-9ba6-18f7559575be => Stopped> {{(pid=72990) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:24:25 user nova-compute[72990]: INFO nova.compute.manager [-] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] VM Stopped (Lifecycle Event)
Aug 27 04:24:25 user nova-compute[72990]: DEBUG nova.compute.manager [None req-5d6b90d3-77df-4c81-b112-3aee7286a45f None None] [instance: 3a714f8e-55be-4b7b-9ba6-18f7559575be] Checking state {{(pid=72990) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:24:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:24:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:35 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:24:40 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:24:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:24:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:24:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:24:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:24:45 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:50 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:54 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:24:54 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72990) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:24:55 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:24:57 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:24:59 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:25:00 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:25:03 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:25:04 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:25:04 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:25:05 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:25:05 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:25:06 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:25:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Starting heal instance info cache {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:25:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Rebuilding the list of instances to heal {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:25:06 user nova-compute[72990]: DEBUG nova.compute.manager [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Didn't find any instances for network info cache update. {{(pid=72990) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 04:25:06 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:25:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:25:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:25:06 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:25:06 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72990) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:25:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:25:07 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:25:07 user nova-compute[72990]: WARNING nova.virt.libvirt.driver [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:25:07 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.121139526367188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72990) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:25:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:25:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:25:07 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:25:07 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72990) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:25:07 user nova-compute[72990]: DEBUG nova.compute.provider_tree [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed in ProviderTree for provider: 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba {{(pid=72990) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:25:07 user nova-compute[72990]: DEBUG nova.scheduler.client.report [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Inventory has not changed for provider 404973ab-f4fc-4ae0-a6c0-c5fb46a2cbba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72990) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:25:07 user nova-compute[72990]: DEBUG nova.compute.resource_tracker [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Compute_service record updated for user:user {{(pid=72990) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:25:07 user nova-compute[72990]: DEBUG oslo_concurrency.lockutils [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=72990) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:25:07 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:25:10 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:25:11 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:25:15 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:25:16 user nova-compute[72990]: DEBUG oslo_service.periodic_task [None req-dab63c5c-8c16-4e24-b21e-6ab23a9266c9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:25:20 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:25:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:25:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:25:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72990) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 04:25:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:25:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72990) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:25:25 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:25:30 user nova-compute[72990]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72990) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}